Abstract:Feature selection is to reduce both the dimensionality of data and the classification error rate (i.e., increase the classification accuracy) of a learning algorithm. The two objectives are often conflicting, thus a multiobjective feature selection method can obtain a set of nondominated feature subsets. Each solution in the set has a different size and a corresponding classification error rate. However, most existing feature selection algorithms have ignored that, for a given size, there can be different feature subsets with very similar or the same accuracy. This article introduces a niching-based multiobjective feature selection method that simultaneously minimizes the number of selected features and the classification error rate. The proposed method conceives to identify: 1) a set of feature subsets with good convergence and distribution and 2) multiple feature subsets choosing the same number of features with almost the same lowest classification error rate. The contributions of this article are threefold. First, a niching and global interaction mutation operator is proposed that can produce promising feature subsets. Second, a newly developed environmental selection mechanism allows equal informative feature subsets to be stored by relaxing the Pareto-dominance relationship. Finally, the proposed subset repairing mechanism can generate better feature subsets and further remove the redundant features. The proposed method is compared against seven multiobjective feature selection algorithms on 19 datasets, including both binary and multiclass classification tasks. The results show that the proposed method can evolve a rich and diverse set of nondominated solutions for different feature selection tasks, and their availability helps in understanding the relationships between features.

Evolutionary Multiobjective Ensemble Learning Based on Bayesian Feature Selection.

Ensemble Learning Using Multi-Objective Evolutionary Algorithms

Multi-objective Ensemble Construction , Learning and Evolution

Evolutionary Multi-Objective Generation of Recurrent Neural Network Ensembles for Time Series Prediction

Multi-objective Ensemble Generation

Feature Selection Based on a Large-Scale Many-Objective Evolutionary Algorithm

Evolutionary Random Neural Ensembles Based on Negative Correlation Learning

An Ensemble of Classifiers with Genetic Algorithm Based Feature Selection

Deep Reinforcement Learning Based Adaptive Environmental Selection for Evolutionary Multi-Objective Optimization.

An Information-Based Elite-Guided Evolutionary Algorithm for Multi-Objective Feature Selection

Multiobjective Differential Evolution for Feature Selection in Classification

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

Multiobjective Sparse Ensemble Learning by Means of Evolutionary Algorithms

Coevolutionary Learning of Neural Network Ensemble for Complex Classification Tasks

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

Reinforcement Learning-Based Multi-Objective Differential Evolution Algorithm for Feature Selection

A Multi-Task Decomposition-Based Evolutionary Algorithm for Tackling High-Dimensional Bi-Objective Feature Selection

Parallel Learning Evolutionary Algorithm Based On Neural Network Ensemble

Genetic Algorithm Based Selective Ensemble with Multiset Representation

Neural Network Regularization and Ensembling Using Multi-Objective Evolutionary Algorithms

Evolutionary bagging for ensemble learning