Abstract:With the rapid development of artificial intelligence in recent years, the research on image processing, text mining, and genome informatics has gradually deepened, and the mining of large-scale databases has begun to receive more and more attention. The objects of data mining have also become more complex, and the data dimensions of mining objects have become higher and higher. Compared with the ultra-high data dimensions, the number of samples available for analysis is too small, resulting in the production of high-dimensional small sample data. High-dimensional small sample data will bring serious dimensional disasters to the mining process. Through feature selection, redundancy and noise features in high-dimensional small sample data can be effectively eliminated, avoiding dimensional disasters and improving the actual efficiency of mining algorithms. However, the existing feature selection methods emphasize the classification or clustering performance of the feature selection results and ignore the stability of the feature selection results, which will lead to unstable feature selection results, and it is difficult to obtain real and understandable features. Based on the traditional feature selection method, this paper proposes an ensemble feature selection method, Random Bits Forest Recursive Clustering Eliminate (RBF-RCE) feature selection method, combined with multiple sets of basic classifiers to carry out parallel learning and screen out the best feature classification results, optimizes the classification performance of traditional feature selection methods, and can also improve the stability of feature selection. Then, this paper analyzes the reasons for the instability of feature selection and introduces a feature selection stability measurement method, the Intersection Measurement (IM), to evaluate whether the feature selection process is stable. The effectiveness of the proposed method is verified by experiments on several groups of high-dimensional small sample data sets.

A new definition for feature selection stability analysis

An information theoretic approach to quantify the stability of feature selection and ranking algorithms

Measuring the Stability of Learned Features

Stability and Reliability Analysis of Nonlinear Stochastic System Using Data-Driven Dimensional Analysis Method

Utilizing stability criteria in choosing feature selection methods yields reproducible results in microbiome data

Stable Feature Selection for Biomarker Discovery

Feature Selection and Feature Stability Measurement Method for High-Dimensional Small Sample Data Based on Big Data Technology

Cluster Stability Selection

Integrated path stability selection

EFSIS: Ensemble Feature Selection Integrating Stability

Discussion of ‘Stability Selection’, by Nicolai Meinshausen and Peter Bühlmann

Statistical Inference for Feature Selection after Optimal Transport-based Domain Adaptation

Trimming Stability Selection increases variable selection robustness

Evaluating the Stability of Deep Learning Latent Feature Spaces

Ensemble learning-based stability improvement method for feature selection towards performance prediction

An Empirical Study on the Equivalence and Stability of Feature Selection for Noisy Software Defect Data

Analysis and comparison of feature selection methods towards performance and stability

Stability Analysis On Rough Set Based Feature Evaluation

Exploring the stability of feature selection for imbalanced intrusion detection data

Loss-guided Stability Selection

Invariant optimal feature selection: A distance discriminant and feature ranking based solution