Abstract:Online streaming feature selection, as a well‐known and effective preprocessing approach in machine learning, is an eternal topic. Amount of online streaming feature selection algorithms have achieved a great deal of success in classification and prediction tasks. However, most of these existing algorithms only concentrate on the relevance between features and labels, and neglect the causal relationships between them. Discovering the potential causal relationships between features and labels, that is, the Markov blanket (MB) of class label, which can build a more interpretable and robust classification model. In this paper, we put forward a causality‐based online streaming feature selection algorithm with neighborhood conditional mutual information. First, we apply neighborhood symmetrical uncertainty to discover a candidate Markov blanket (CMB) with causal information. Then, neighborhood conditional mutual information instead of conditional independence test is used to delete the false positives in CMB, which can significantly alleviate the computational cost. Moreover, we utilize the updated CMB to choose the true spouses, which may be mistakenly deleted during the process of removing false positives, and then acquire an optimal MB as the online selected feature subset. Finally, causality‐based online streaming feature selection with neighborhood conditional mutual information is compared with four well‐established online streaming feature selection methods on 13 real‐world datasets. Experiment results show that the proposed algorithm outperforms these online streaming feature selection algorithms.

A Unified View of Causal and Non-causal Feature Selection

Multi-Source Causal Feature Selection

Causality-based Feature Selection: Methods and Evaluations

Causality-based Feature Selection

Data Fusion Using Feature Selection Based Causal Network Algorithm

A Light Causal Feature Selection Approach to High-Dimensional Data

Causal Feature Selection Method Based on Extended Markov Blanket

Causal Feature Selection With Dual Correction

Research on the Multi-Source Causal Feature Selection Method Based on Multiple Causal Relevance

Multi-Label Causal Feature Selection

Causally-Aware Unsupervised Feature Selection Learning

Multi-source Multi-label Causal Feature Selection

Accurate Markov Boundary Discovery for Causal Feature Selection.

Multilabel Causal Variable Discovery in Multisource

Causal Feature Selection with Imbalanced Data

Fair Feature Selection: A Causal Perspective

Fair Causal Feature Selection

Bivariate Causal Discovery using Bayesian Model Selection

A Two-Stage Causality Method for Time Series Prediction Based on Feature Selection and Momentary Conditional Independence

Causality‐based Online Streaming Feature Selection

Causal Feature Selection via Transfer Entropy