Abstract:Feature selection is to reduce both the dimensionality of data and the classification error rate (i.e., increase the classification accuracy) of a learning algorithm. The two objectives are often conflicting, thus a multiobjective feature selection method can obtain a set of nondominated feature subsets. Each solution in the set has a different size and a corresponding classification error rate. However, most existing feature selection algorithms have ignored that, for a given size, there can be different feature subsets with very similar or the same accuracy. This article introduces a niching-based multiobjective feature selection method that simultaneously minimizes the number of selected features and the classification error rate. The proposed method conceives to identify: 1) a set of feature subsets with good convergence and distribution and 2) multiple feature subsets choosing the same number of features with almost the same lowest classification error rate. The contributions of this article are threefold. First, a niching and global interaction mutation operator is proposed that can produce promising feature subsets. Second, a newly developed environmental selection mechanism allows equal informative feature subsets to be stored by relaxing the Pareto-dominance relationship. Finally, the proposed subset repairing mechanism can generate better feature subsets and further remove the redundant features. The proposed method is compared against seven multiobjective feature selection algorithms on 19 datasets, including both binary and multiclass classification tasks. The results show that the proposed method can evolve a rich and diverse set of nondominated solutions for different feature selection tasks, and their availability helps in understanding the relationships between features.

Neurodynamics-driven supervised feature selection.

Supervised Feature Selection via Collaborative Neurodynamic Optimization

A neurodynamic optimization approach to supervised feature selection via fractional programming

Two-timescale neurodynamic approaches to supervised feature selection based on alternative problem formulations

Feature Selection Based on Dependency Margin

Feature Selection for Monotonic Classification Via Maximizing Monotonic Dependency

Unsupervised Feature Selection by Preserving Stochastic Neighbors

Adaptive Dual Graphs and Non-Convex Constraint Based Embedded Feature Selection

Nonlinear Joint Unsupervised Feature Selection

A New Supervised Feature Selection Method for Pattern Classification.

Unsupervised Feature Selection via Nonnegative Orthogonal Constrained Regularized Minimization

A Novel Approach for Stable Selection of Informative Redundant Features from High Dimensional fMRI Data

Cardinality-constrained portfolio selection via two-timescale duplex neurodynamic optimization

Learning to Maximize Mutual Information for Dynamic Feature Selection

Feature Selection Considering Two Types of Feature Relevancy and Feature Interdependency.

Nonlinear Feature Selection Neural Network Via Structured Sparse Regularization

Joint nonlinear feature selection and continuous values regression network

A Novel Feature Selection with Many-Objective Optimization and Learning Mechanism

Feature Selection Using Double Parallel Feedforward Neural Networks And Particle Swarm Optimization

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

Neuro-Symbolic Embedding for Short and Effective Feature Selection via Autoregressive Generation