Abstract:Feature selection (FS) is recognized for its role in enhancing the performance of learning algorithms, especially for high-dimensional datasets. In recent times, FS has been framed as a multi-objective optimization problem, leading to the application of various multi-objective evolutionary algorithms (MOEAs) to address it. However, the solution space expands exponentially with the dataset's dimensionality. Simultaneously, the extensive search space often results in numerous local optimal solutions due to a large proportion of unrelated and redundant features [H. Adeli and H. S. Park, Fully automated design of super-high-rise building structures by a hybrid ai model on a massively parallel machine, AI Mag. 17 (1996) 87-93]. Consequently, existing MOEAs struggle with local optima stagnation, particularly in large-scale multi-objective FS problems (LSMOFSPs). Different LSMOFSPs generally exhibit unique characteristics, yet most existing MOEAs rely on a single candidate solution generation strategy (CSGS), which may be less efficient for diverse LSMOFSPs [H. S. Park and H. Adeli, Distributed neural dynamics algorithms for optimization of large steel structures, J. Struct. Eng. ASCE 123 (1997) 880-888; M. Aldwaik and H. Adeli, Advances in optimization of highrise building structures, Struct. Multidiscip. Optim. 50 (2014) 899-919; E. G. González, J. R. Villar, Q. Tan, J. Sedano and C. Chira, An efficient multi-robot path planning solution using a* and coevolutionary algorithms, Integr. Comput. Aided Eng. 30 (2022) 41-52]. Moreover, selecting an appropriate MOEA and determining its corresponding parameter values for a specified LSMOFSP is time-consuming. To address these challenges, a multi-objective self-adaptive particle swarm optimization (MOSaPSO) algorithm is proposed, combined with a rapid nondominated sorting approach. MOSaPSO employs a self-adaptive mechanism, along with five modified efficient CSGSs, to generate new solutions. Experiments were conducted on ten datasets, and the results demonstrate that the number of features is effectively reduced by MOSaPSO while lowering the classification error rate. Furthermore, superior performance is observed in comparison to its counterparts on both the training and test sets, with advantages becoming increasingly evident as the dimensionality increases.

Dual Sparse Structured Subspaces and Graph Regularisation for Particle Swarm Optimisation-Based Multi-Label Feature Selection

Sparse low-redundancy multilabel feature selection based on dynamic local structure preservation and triple graphs exploration

Multi-label feature selection based on stable label relevance and label-specific features

Multi-Objective Self-Adaptive Particle Swarm Optimization for Large-Scale Feature Selection in Classification

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

Label Correlation Guided Feature Selection for Multi-label Learning.

A novel feature selection approach with Pareto optimality for multi-label data

Semi-supervised feature selection based on pairwise constraint-guided dual space latent representation learning and double sparse graphs discriminant

A Multi-Objective Particle Swarm Optimisation for Filter-Based Feature Selection in Classification Problems

Structured Sparse Model Based Feature Selection and Classification for Hyperspectral Imagery

Feature Selection for Multi-label Learning: A Systematic Literature Review and Some Experimental Evaluations

Parallel dual-channel multi-label feature selection

Multi-class feature selection via Sparse Softmax with a discriminative regularization

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

Dynamic multi-label feature selection algorithm based on label importance and label correlation

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models

A particle swarm optimisation based multi-objective filter approach to feature selection for classification

Multi-label Feature selection with adaptive graph learning and label information enhancement

Enhanced multi-label feature selection considering label-specific relevant information

Double-Structured Sparsity Guided Flexible Embedding Learning for Unsupervised Feature Selection