Abstract:In the realm of machine learning, feature selection emerges as a prevalent data preprocessing technique, playing a crucial role in enhancing model performance across diverse downstream tasks such as fault diagnosis, biological recognition, and object detection. Nevertheless, the challenge of incomplete supervision, stemming from limited labeled data availability, poses a formidable obstacle in acquiring the optimal feature subset for model input. To address the problem that label scarcity may deteriorate the feature evaluation and selection, we introduce a novel semi-supervised feature selection algorithm termed Semi2MNR integrating the principles of Minimum Neighborhood Redundancy and Maximum Neighborhood Relevancy. Firstly, k -nearest neighborhood granulation is leveraged to construct a collection of neighborhood uncertainty measures from the perspective of information theory. Then, the neighborhood mutual information is expressed to assess the feature-to-label relevance based on labeled samples and feature-to-feature redundance based on unlabeled samples. Finally, as the evaluation criterion of min-neighborhood-redundancy and max-neighborhood-relevancy is constrained, a forward sequential searching algorithm is devised to identify the min-redundant and max-relevant features. The empirical findings from our experiments on 12 UCI data sets unequivocally demonstrate the superiority of Semi2MNR in the presence of partially labeled data with varying labeling rates. Comparative analysis against other feature selection algorithms suggests that CART, KNN, and SVM classifiers fed with features selected by Semi2MNR consistently yield optimal accuracies.

Semisupervised Feature Selection Based on Relevance and Redundancy Criteria.

Semi-supervised feature selection by minimum neighborhood redundancy and maximum neighborhood relevancy

Feature Selection with Integrated Relevance and Redundancy Optimization

Feature Selection Based on Dependency Margin

Feature Selection with Maximal Relevance and Minimal Supervised Redundancy

Semi-supervised Minimum Redundancy Maximum Relevance Feature Selection for Audio Classification

A New Method for Redundancy Analysis in Feature Selection

Multi-label Feature Selection Via Redundancy of the Selected Feature Set

Semi-supervised Multi-Label Feature Selection Using Hessian Energy based on Maximum Relevance and Minimum Redundancy

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

Multi-label Feature Selection Based on Max-Dependency and Min-Redundancy.

Multi-label Feature Selection Algorithm Based on Joint Mutual Information of Max-Relevance and Min-Redundancy

A comparative study of redundant feature detection based feature selection methods

Fuzzy Mutual Information Based Min-Redundancy and Max-Relevance Heterogeneous Feature Selection

Feature selection based on min-redundancy and max-consistency

Feature Selection for Monotonic Classification

A New Supervised Feature Selection Method for Pattern Classification.

Fuzzy Entropy Based Max-Relevancy and Min-Redundancy Feature Selection.

Feature Redundancy Term Variation for Mutual Information-Based Feature Selection

Feature Selection for Monotonic Classification Via Maximizing Monotonic Dependency

Robust Dual-Graph Regularized and Minimum Redundancy Based on Self-Representation for Semi-Supervised Feature Selection