Abstract:With the rapid development of artificial intelligence in recent years, the research on image processing, text mining, and genome informatics has gradually deepened, and the mining of large-scale databases has begun to receive more and more attention. The objects of data mining have also become more complex, and the data dimensions of mining objects have become higher and higher. Compared with the ultra-high data dimensions, the number of samples available for analysis is too small, resulting in the production of high-dimensional small sample data. High-dimensional small sample data will bring serious dimensional disasters to the mining process. Through feature selection, redundancy and noise features in high-dimensional small sample data can be effectively eliminated, avoiding dimensional disasters and improving the actual efficiency of mining algorithms. However, the existing feature selection methods emphasize the classification or clustering performance of the feature selection results and ignore the stability of the feature selection results, which will lead to unstable feature selection results, and it is difficult to obtain real and understandable features. Based on the traditional feature selection method, this paper proposes an ensemble feature selection method, Random Bits Forest Recursive Clustering Eliminate (RBF-RCE) feature selection method, combined with multiple sets of basic classifiers to carry out parallel learning and screen out the best feature classification results, optimizes the classification performance of traditional feature selection methods, and can also improve the stability of feature selection. Then, this paper analyzes the reasons for the instability of feature selection and introduces a feature selection stability measurement method, the Intersection Measurement (IM), to evaluate whether the feature selection process is stable. The effectiveness of the proposed method is verified by experiments on several groups of high-dimensional small sample data sets.

Feature Selection Based on Data Clustering

A Feature Selection Framework Based on Supervised Data Clustering

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

Feature Selection with Conditional Mutual Information Considering Feature Interaction

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Feature Selection with Attributes Clustering by Maximal Information Coefficient

Heuristic feature selection method for clustering

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

A New Unsupervised Feature Selection Algorithm Using Similarity-Based Feature Clustering.

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Unsupervised feature selection for multi-cluster data

Higher Order Mutual Information Approximation for Feature Selection

A fusion of centrality and correlation for feature selection

Feature selection based on mutual information with correlation coefficient

Clustering-based feature subset selection with analysis on the redundancy–complementarity dimension

Feature Selection and Feature Stability Measurement Method for High-Dimensional Small Sample Data Based on Big Data Technology

A novel method of constrained feature selection by the measurement of pairwise constraints uncertainty

Feature selection and threshold method based on fuzzy joint mutual information

A Supervised Feature Selection Method For Mixed-Type Data using Density-based Feature Clustering

An information-theoretic feature selection method based on estimation of Markov blanket

An Intrusion Detection Feature Selection Method Based on Improved Mutual Information