Abstract:Feature selection is to reduce both the dimensionality of data and the classification error rate (i.e., increase the classification accuracy) of a learning algorithm. The two objectives are often conflicting, thus a multiobjective feature selection method can obtain a set of nondominated feature subsets. Each solution in the set has a different size and a corresponding classification error rate. However, most existing feature selection algorithms have ignored that, for a given size, there can be different feature subsets with very similar or the same accuracy. This article introduces a niching-based multiobjective feature selection method that simultaneously minimizes the number of selected features and the classification error rate. The proposed method conceives to identify: 1) a set of feature subsets with good convergence and distribution and 2) multiple feature subsets choosing the same number of features with almost the same lowest classification error rate. The contributions of this article are threefold. First, a niching and global interaction mutation operator is proposed that can produce promising feature subsets. Second, a newly developed environmental selection mechanism allows equal informative feature subsets to be stored by relaxing the Pareto-dominance relationship. Finally, the proposed subset repairing mechanism can generate better feature subsets and further remove the redundant features. The proposed method is compared against seven multiobjective feature selection algorithms on 19 datasets, including both binary and multiclass classification tasks. The results show that the proposed method can evolve a rich and diverse set of nondominated solutions for different feature selection tasks, and their availability helps in understanding the relationships between features.

Feature Subspace Learning-based Binary Differential Evolution Algorithm for Unsupervised Feature Selection

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Multiobjective Differential Evolution for Feature Selection in Classification

Feature Selection Using Diversity-Based Multi-objective Binary Differential Evolution

Subspace Learning for Unsupervised Feature Selection Via Matrix Factorization.

Evolutionary model selection in unsupervised learning

Feature clustering-Assisted feature selection with differential evolution

Discriminative Sparse Subspace Learning and Its Application to Unsupervised Feature Selection

A binary individual search strategy-based bi-objective evolutionary algorithm for high-dimensional feature selection

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Unsupervised Feature Selection Via Controllable Adaptive Graph Learning and Discriminative Feature Learning.

Unsupervised feature selection for multi-cluster data

Unsupervised feature selection algorithm with a multi-objective evolutionary model for fault diagnosis

Differential Evolution With Duplication Analysis for Feature Selection in Classification

Subspace Clustering Guided Unsupervised Feature Selection.

Feature Selection Based on a Large-Scale Many-Objective Evolutionary Algorithm

Subspace Learning for Feature Selection via Rank Revealing QR Factorization: Unsupervised and Hybrid Approaches with Non-negative Matrix Factorization and Evolutionary Algorithm

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

Unsupervised feature selection via dual space-based low redundancy scores and extended OLSDA