Abstract:Feature selection is to reduce both the dimensionality of data and the classification error rate (i.e., increase the classification accuracy) of a learning algorithm. The two objectives are often conflicting, thus a multiobjective feature selection method can obtain a set of nondominated feature subsets. Each solution in the set has a different size and a corresponding classification error rate. However, most existing feature selection algorithms have ignored that, for a given size, there can be different feature subsets with very similar or the same accuracy. This article introduces a niching-based multiobjective feature selection method that simultaneously minimizes the number of selected features and the classification error rate. The proposed method conceives to identify: 1) a set of feature subsets with good convergence and distribution and 2) multiple feature subsets choosing the same number of features with almost the same lowest classification error rate. The contributions of this article are threefold. First, a niching and global interaction mutation operator is proposed that can produce promising feature subsets. Second, a newly developed environmental selection mechanism allows equal informative feature subsets to be stored by relaxing the Pareto-dominance relationship. Finally, the proposed subset repairing mechanism can generate better feature subsets and further remove the redundant features. The proposed method is compared against seven multiobjective feature selection algorithms on 19 datasets, including both binary and multiclass classification tasks. The results show that the proposed method can evolve a rich and diverse set of nondominated solutions for different feature selection tasks, and their availability helps in understanding the relationships between features.

A unified feature and instance selection framework using optimum experimental design.

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

An Efficient Framework for Unsupervised Feature Selection

Effective Learning with Joint Discriminative and Representative Feature Selection

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

Efficient Multi-view Unsupervised Feature Selection with Adaptive Structure Learning and Inference

Rethinking Embedded Unsupervised Feature Selection: A Simple Joint Approach

Size Adaptive Selection of Most Informative Features

A New Feature Selection Method Based on Monarch Butterfly Optimization and Fisher Criterion.

A Unified Feature Selection Framework for Graph Embedding on High Dimensional Data

Feature Selection Based on Features Unit

Unified View Imputation and Feature Selection Learning for Incomplete Multi-view Data

Feature Selection Boosted by Unselected Features.

Feature and Instance Joint Selection: A Reinforcement Learning Perspective

Robust Unsupervised Feature Selection Via Matrix Factorization

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

MetaFS: An Effective Wrapper Feature Selection via Meta Learning

An evolutionary multi-objective optimization framework of discretization-based feature selection for classification

Learning to Maximize Mutual Information for Dynamic Feature Selection

Dependence Guided Unsupervised Feature Selection