Abstract:Feature selection is to reduce both the dimensionality of data and the classification error rate (i.e., increase the classification accuracy) of a learning algorithm. The two objectives are often conflicting, thus a multiobjective feature selection method can obtain a set of nondominated feature subsets. Each solution in the set has a different size and a corresponding classification error rate. However, most existing feature selection algorithms have ignored that, for a given size, there can be different feature subsets with very similar or the same accuracy. This article introduces a niching-based multiobjective feature selection method that simultaneously minimizes the number of selected features and the classification error rate. The proposed method conceives to identify: 1) a set of feature subsets with good convergence and distribution and 2) multiple feature subsets choosing the same number of features with almost the same lowest classification error rate. The contributions of this article are threefold. First, a niching and global interaction mutation operator is proposed that can produce promising feature subsets. Second, a newly developed environmental selection mechanism allows equal informative feature subsets to be stored by relaxing the Pareto-dominance relationship. Finally, the proposed subset repairing mechanism can generate better feature subsets and further remove the redundant features. The proposed method is compared against seven multiobjective feature selection algorithms on 19 datasets, including both binary and multiclass classification tasks. The results show that the proposed method can evolve a rich and diverse set of nondominated solutions for different feature selection tasks, and their availability helps in understanding the relationships between features.

Reinforcement Learning-Based Multi-Objective Differential Evolution Algorithm for Feature Selection

Multimodal Multiobjective Differential Evolution Algorithm Based on Enhanced Decision Space Search

Multiobjective Differential Evolution for Feature Selection in Classification

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

Binary Differential Evolution with Self-Learning for Multi-Objective Feature Selection.

MOFSRank: A Multiobjective Evolutionary Algorithm for Feature Selection in Learning to Rank

Reinforcement learning-based differential evolution algorithm for constrained multi-objective optimization problems

A multi-objective feature selection based on differential evolution

MLFS-CCDE: Multi-Objective Large-Scale Feature Selection by Cooperative Coevolutionary Differential Evolution.

Multi-objective Differential Evolution Algorithm for Multi-label Feature Selection in Classification.

Feature Selection Using Diversity-Based Multi-objective Binary Differential Evolution

MPEA-FS: A decomposition-based multi-population evolutionary algorithm for high-dimensional feature selection

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

A Dividing-Based Many-Objective Evolutionary Algorithm for Large-Scale Feature Selection.

An Information-Based Elite-Guided Evolutionary Algorithm for Multi-Objective Feature Selection

Feature Selection Based on a Large-Scale Many-Objective Evolutionary Algorithm

MOFS-REPLS: A Large-Scale Multi-Objective Feature Selection Algorithm Based on Real-Valued Encoding and Preference Leadership Strategy

A Multi-objective Feature Selection Method Considering the Interaction Between Features

Differential Evolution With Duplication Analysis for Feature Selection in Classification

A decomposition-based multi-objective immune algorithm for feature selection in learning to rank

A competitive mechanism based multi-objective differential evolution algorithm and its application in feature selection