Abstract:The discovery of Markov blanket (MB) for feature selection has attracted much attention in recent years, since the MB of the class attribute is the optimal feature subset for feature selection. However, almost all existing MB discovery algorithms focus on either improving computational efficiency or boosting learning accuracy, instead of both. In this article, we propose a novel MB discovery algorithm for balancing efficiency and accuracy, called <underline>BA</underline>lanced <underline>M</underline>arkov <underline>B</underline>lanket (BAMB) discovery. To achieve this goal, given a class attribute of interest, BAMB finds candidate PC (parents and children) and spouses and removes false positives from the candidate MB set in one go. Specifically, once a feature is successfully added to the current PC set, BAMB finds the spouses with regard to this feature, then uses the updated PC and the spouse set to remove false positives from the current MB set. This makes the PC and spouses of the target as small as possible and thus achieves a trade-off between computational efficiency and learning accuracy. In the experiments, we first compare BAMB with 8 state-of-the-art MB discovery algorithms on 7 benchmark Bayesian networks, then we use 10 real-world datasets and compare BAMB with 12 feature selection algorithms, including 8 state-of-the-art MB discovery algorithms and 4 other well-established feature selection methods. On prediction accuracy, BAMB outperforms 12 feature selection algorithms compared. On computational efficiency, BAMB is close to the IAMB algorithm while it is much faster than the remaining seven MB discovery algorithms.

An Approximate Markov Blanket Feature Selection Algorithm

Strong Approximate Markov Blanket and Its Application on Filter-Based Feature Selection

An information-theoretic feature selection method based on estimation of Markov blanket

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Markov Blanket Feature Selection Using Representative Sets

Redundant Feature Elimination By Using Approximate Markov Blanket Based On Discriminative Contribution

A New Feature Selection Method for Handling Redundant Information in Text Classification

Incremental wrapper based gene selection with Markov blanket

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Efficient Method for Feature Selection in Text Classification

A Fast Feature Selection Approach Based on Rough Set Boundary Regions

Markov Blanket Feature Selection with Non-faithful Data Distributions

An Effective Feature Selection Method For Text Categorization

Clustering-based feature subset selection with analysis on the redundancy–complementarity dimension

A New Feature Selection Based on Comprehensive Measurement Both in Inter-Category and Intra-Category for Text Categorization

A New Supervised Feature Selection Method for Pattern Classification.

Effective Feature Selection Using Feature Vector Graph for Classification

Improved Document Feature Selection with Categorical Parameter for Text Classification.

Relative Fuzzy Rough Approximations for Feature Selection and Classification

Novel Feature Selection Method Based on Random Walk and Artificial Bee Colony

BAMB: A Balanced Markov Blanket Discovery Approach to Feature Selection.