Abstract:Multi-source streaming feature selection in an online manner has attracted considerable attention, from researchers because it can reduce the dimensionality of heterogeneous big data. However, traditional online algorithms such as Alpha-investing, Online Streaming Feature Selection (OSFS), Online Group Feature Selection (OGFS) and Scalable and Accurate OnLine Approach (SAOLA) consider only a single data source with fixed instances, and are not directly applicable to multi-source data. Multi-source Causal Feature Selection (MCFS) can search for an invariant set in multiple interventional datasets. However, fixed feature spaces are restrained, and exactly these same features are required among multi-source data. To overcome these limitations, we propose a novel method known as Multi-source Streaming Feature Selection (MSFS) to tackle the feature selection problem for multi-source streaming features. The MSFS algorithm addresses a new feature from a random source in three phases: relevance, intra-source redundancy, and inter-source redundancy analyses. That is, MSFS attempts to mine the potential relationships among different data sources rather than only independently consider each data source. In particular, each new feature is analyzed online using the overlapping instances from all data sources, and the Markov blanket (MB) of the target variable is dynamically adjusted. To evaluate the performance of the MSFS algorithm, we compare it with that of the abovementioned algorithms on 14 datasets and two real-world scenarios. The results demonstrate that MSFS outperforms the existing algorithms in classification accuracy and number of selected features.

Group Feature Selection With Streaming Features

Online Group Feature Selection from Feature Streams

Mining Fuzzy Association Rules in Data Streams

Online feature selection for multi-source streaming features

Online Feature Selection with Group Structure Analysis

Fair Streaming Feature Selection

Online Multi-Label Streaming Feature Selection Based on Label Group Correlation and Feature Interaction

Online Group Feature Selection

Online Heterogeneous Streaming Feature Selection without Feature Type Information

Online Feature Selection for Streaming Features with High Redundancy Using Sliding-Window Sampling

Online early terminated streaming feature selection based on Rough Set theory

Online Streaming Feature Selection Via Conditional Independence

Fairness-Aware Streaming Feature Selection with Causal Graphs

Adaptive Sparse Confidence-Weighted Learning for Online Feature Selection.

Text Stream Clustering Algorithm Based on Adaptive Feature Selection.

Feature Selection in the Data Stream Based on Incremental Markov Boundary Learning

Kernelized fuzzy rough sets based online streaming feature selection for large-scale hierarchical classification

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A Feature Weighted Ensemble Classifier on Stream Data

LOFS: Library of Online Streaming Feature Selection

Multi-label Online Streaming Feature Selection Algorithms Via Extending Alpha-Investing Strategy