Abstract:Feature selection (FS) is an important data pre-processing technique in classification. In most cases, FS can improve classification accuracy and reduce feature dimension, so it can be regarded as a multi-objective optimization problem. Many evolutionary computation techniques have been applied to FS problems and achieved good results. However, an increase in data dimension means that search difficulty also greatly increases, and EC algorithms with insufficient search ability maybe only find sub-optimal solutions in high probability. Moreover, an improper initial population may negatively affect the convergence speed of algorithms. To solve the problems highlighted above, this paper proposes MOEA-ISa: a multi-objective evolutionary algorithm with interval based initialization and self-adaptive crossover operator for large-scale FS. The proposed interval based initialization can limit the number of selected features for solution to improve the distribution of the initial population in the target space and reduce the similarity of the initial population in the decision space. The proposed self-adaptive crossover operator can determine the number of nonzero genes in offspring according to the similarity of parents, and it combines with the feature weights obtained by ReliefF method to improve the quality of offspring. In the experiments, the proposed algorithm was compared with six other algorithms on 13 benchmark UCI datasets and two benchmark LIBSVM datasets, and an ablation experiment was performed on MOEA-ISa. The results show that MOEA-ISa’s performance is better than the six other algorithms for solving large-scale FS problems, and the proposed interval based initialization and self-adaptive crossover operator can effectively improve the performance of MOEA-ISa. The source code of MOEA-ISa is available on GitHub at https://github.com/xueyunuist/MOEA-ISa.

Modern Medicine and the Rejection of Death

A self-adaptive multi-objective feature selection approach for classification problems

Multi-objective particle swarm optimization with adaptive strategies for feature selection

Exploratory Study of Sorting Particle Swarm Optimizer for Multiobjective Design Optimization

Feature Selection Based on Adaptive Particle Swarm Optimization with Leadership Learning

A particle swarm optimisation based multi-objective filter approach to feature selection for classification

A Multi-Objective Particle Swarm Optimisation for Filter-Based Feature Selection in Classification Problems

A Feature Selection Method Based on Feature-Label Correlation Information and Self-Adaptive MOPSO

A multi-objective evolutionary algorithm with interval based initialization and self-adaptive crossover operator for large-scale feature selection in classification

MOCPSO: A multi-objective cooperative particle swarm optimization algorithm with dual search strategies

MOFS-REPLS: A Large-Scale Multi-Objective Feature Selection Algorithm Based on Real-Valued Encoding and Preference Leadership Strategy

Compressed-Encoding Particle Swarm Optimization with Fuzzy Learning for Large-Scale Feature Selection

Variable-Size Cooperative Coevolutionary Particle Swarm Optimization for Feature Selection on High-Dimensional Data

Multiobjective Particle Swarm Optimization for Feature Selection With Fuzzy Cost

A Constrained Competitive Swarm Optimizer With an SVM-Based Surrogate Model for Feature Selection

An improved feature selection method based on angle-guided multi-objective PSO and feature-label mutual information

Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models

Multi-objective Particle Swarm Optimization Algorithm Based on Crowding Distance Sorting and Its Application

Multi-objective particle swarm optimization with R2 indicator and adaptive method

A multi-objective feature selection approach based on chemical reaction optimization

Feature selection using bare-bones particle swarm optimization with mutual information