Abstract:Feature selection (FS) is recognized for its role in enhancing the performance of learning algorithms, especially for high-dimensional datasets. In recent times, FS has been framed as a multi-objective optimization problem, leading to the application of various multi-objective evolutionary algorithms (MOEAs) to address it. However, the solution space expands exponentially with the dataset's dimensionality. Simultaneously, the extensive search space often results in numerous local optimal solutions due to a large proportion of unrelated and redundant features [H. Adeli and H. S. Park, Fully automated design of super-high-rise building structures by a hybrid ai model on a massively parallel machine, AI Mag. 17 (1996) 87-93]. Consequently, existing MOEAs struggle with local optima stagnation, particularly in large-scale multi-objective FS problems (LSMOFSPs). Different LSMOFSPs generally exhibit unique characteristics, yet most existing MOEAs rely on a single candidate solution generation strategy (CSGS), which may be less efficient for diverse LSMOFSPs [H. S. Park and H. Adeli, Distributed neural dynamics algorithms for optimization of large steel structures, J. Struct. Eng. ASCE 123 (1997) 880-888; M. Aldwaik and H. Adeli, Advances in optimization of highrise building structures, Struct. Multidiscip. Optim. 50 (2014) 899-919; E. G. González, J. R. Villar, Q. Tan, J. Sedano and C. Chira, An efficient multi-robot path planning solution using a* and coevolutionary algorithms, Integr. Comput. Aided Eng. 30 (2022) 41-52]. Moreover, selecting an appropriate MOEA and determining its corresponding parameter values for a specified LSMOFSP is time-consuming. To address these challenges, a multi-objective self-adaptive particle swarm optimization (MOSaPSO) algorithm is proposed, combined with a rapid nondominated sorting approach. MOSaPSO employs a self-adaptive mechanism, along with five modified efficient CSGSs, to generate new solutions. Experiments were conducted on ten datasets, and the results demonstrate that the number of features is effectively reduced by MOSaPSO while lowering the classification error rate. Furthermore, superior performance is observed in comparison to its counterparts on both the training and test sets, with advantages becoming increasingly evident as the dimensionality increases.

A self-adaptive multi-objective feature selection approach for classification problems

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Multi-Objective Self-Adaptive Particle Swarm Optimization for Large-Scale Feature Selection in Classification

Adaptive crossover operator based multi-objective binary genetic algorithm for feature selection in classification

A multi-objective evolutionary algorithm with interval based initialization and self-adaptive crossover operator for large-scale feature selection in classification

A multi-objective feature selection approach based on chemical reaction optimization

A Survey on Evolutionary Multiobjective Feature Selection in Classification: Approaches, Applications, and Challenges

A problem-specific non-dominated sorting genetic algorithm for supervised feature selection

Multi-objective particle swarm optimization with adaptive strategies for feature selection

Multi-objective Feature Selection with Missing Data in Classification

A multi-objective optimization algorithm for feature selection problems

Symmetric uncertainty based decomposition multi-objective immune algorithm for feature selection

Surrogate-Assisted Flip for Evolutionary High-Dimensional Multiobjective Feature Selection.

MPEA-FS: A decomposition-based multi-population evolutionary algorithm for high-dimensional feature selection

A Multi-objective Feature Selection Method Considering the Interaction Between Features

A particle swarm optimisation based multi-objective filter approach to feature selection for classification

A Feature Selection Method Based on Multi-objective Optimisation with Gravitational Search Algorithm.

Multi-objective optimization algorithm based on clustering guided binary equilibrium optimizer and NSGA-III to solve high-dimensional feature selection problem

Multi-objective Binary Coordinate Search for Feature Selection

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

MOBCSA: Multi-Objective Binary Cuckoo Search Algorithm for Features Selection in Bioinformatics