Abstract:Feature selection is to reduce both the dimensionality of data and the classification error rate (i.e., increase the classification accuracy) of a learning algorithm. The two objectives are often conflicting, thus a multiobjective feature selection method can obtain a set of nondominated feature subsets. Each solution in the set has a different size and a corresponding classification error rate. However, most existing feature selection algorithms have ignored that, for a given size, there can be different feature subsets with very similar or the same accuracy. This article introduces a niching-based multiobjective feature selection method that simultaneously minimizes the number of selected features and the classification error rate. The proposed method conceives to identify: 1) a set of feature subsets with good convergence and distribution and 2) multiple feature subsets choosing the same number of features with almost the same lowest classification error rate. The contributions of this article are threefold. First, a niching and global interaction mutation operator is proposed that can produce promising feature subsets. Second, a newly developed environmental selection mechanism allows equal informative feature subsets to be stored by relaxing the Pareto-dominance relationship. Finally, the proposed subset repairing mechanism can generate better feature subsets and further remove the redundant features. The proposed method is compared against seven multiobjective feature selection algorithms on 19 datasets, including both binary and multiclass classification tasks. The results show that the proposed method can evolve a rich and diverse set of nondominated solutions for different feature selection tasks, and their availability helps in understanding the relationships between features.

An Information-Based Elite-Guided Evolutionary Algorithm for Multi-Objective Feature Selection

Feature Selection Based on a Large-Scale Many-Objective Evolutionary Algorithm

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

Multiobjective Differential Evolution for Feature Selection in Classification

Information Gain-based Multi-objective Evolutionary Algorithm for Feature Selection

A Knowledge-Guided Competitive Co-Evolutionary Algorithm for Feature Selection

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

Multi-objective Differential Evolution Algorithm for Multi-label Feature Selection in Classification.

A binary individual search strategy-based bi-objective evolutionary algorithm for high-dimensional feature selection

A Multi-Task Decomposition-Based Evolutionary Algorithm for Tackling High-Dimensional Bi-Objective Feature Selection

A bidirectional dynamic grouping multi-objective evolutionary algorithm for feature selection on high-dimensional classification

A Particle Swarm Optimization Based Multiobjective Memetic Algorithm for High-Dimensional Feature Selection

An Entropy Driven Multiobjective Particle Swarm Optimization Algorithm for Feature Selection

Feature Selection Using Diversity-Based Multi-objective Binary Differential Evolution

A Multi-Objective Evolutionary Algorithm With Hierarchical Clustering-Based Selection

Balancing Different Optimization Difficulty Between Objectives in Multi-Objective Feature Selection

An Evolutionary Algorithm with Clustering-based Selection Strategies for Multi-objective Optimization

A Classification and Pareto Domination Based Multiobjective Evolutionary Algorithm.

A Many-Objective Evolutionary Algorithm Based on Dual Selection Strategy

Reinforcement Learning-Based Multi-Objective Differential Evolution Algorithm for Feature Selection

A multi-objective feature selection based on differential evolution