Abstract:With the rapid development of artificial intelligence in recent years, the research on image processing, text mining, and genome informatics has gradually deepened, and the mining of large-scale databases has begun to receive more and more attention. The objects of data mining have also become more complex, and the data dimensions of mining objects have become higher and higher. Compared with the ultra-high data dimensions, the number of samples available for analysis is too small, resulting in the production of high-dimensional small sample data. High-dimensional small sample data will bring serious dimensional disasters to the mining process. Through feature selection, redundancy and noise features in high-dimensional small sample data can be effectively eliminated, avoiding dimensional disasters and improving the actual efficiency of mining algorithms. However, the existing feature selection methods emphasize the classification or clustering performance of the feature selection results and ignore the stability of the feature selection results, which will lead to unstable feature selection results, and it is difficult to obtain real and understandable features. Based on the traditional feature selection method, this paper proposes an ensemble feature selection method, Random Bits Forest Recursive Clustering Eliminate (RBF-RCE) feature selection method, combined with multiple sets of basic classifiers to carry out parallel learning and screen out the best feature classification results, optimizes the classification performance of traditional feature selection methods, and can also improve the stability of feature selection. Then, this paper analyzes the reasons for the instability of feature selection and introduces a feature selection stability measurement method, the Intersection Measurement (IM), to evaluate whether the feature selection process is stable. The effectiveness of the proposed method is verified by experiments on several groups of high-dimensional small sample data sets.

An Unsupervised Feature Ranking Scheme By Discovering Biclusters

Exploiting Local Coherent Patterns for Unsupervised Feature Ranking

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

Unsupervised Feature Selection with Ordinal Locality.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

An Unsupervised Feature Selection Method Based on Improved ReliefF and Bisecting K-means

Biclusters Based Visual Exploration of Multivariate Scientific Data

Finding Distinct Biclusters from Background in Gene Expression Matrices.

Feature Selection with Attributes Clustering by Maximal Information Coefficient

Hierarchical Feature Selection for Ranking.

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

A New Unsupervised Feature Selection Algorithm Using Similarity-Based Feature Clustering.

A Feature Selection Framework Based on Supervised Data Clustering

RecBic: a fast and accurate algorithm recognizing trend-preserving biclusters

Feature Ranking in Rough Sets

Unsupervised feature selection for multi-cluster data

Query Clustering Based on Query Requirements for Ranking

Unsupervised Feature Selection Algorithm Based on Dual Manifold Re-ranking

Learning to Rank Collections.

Cascaded two-stage feature clustering and selection via separability and consistency in fuzzy decision systems

Feature Selection and Feature Stability Measurement Method for High-Dimensional Small Sample Data Based on Big Data Technology