Abstract:Feature selection (FS) is an important data pre-processing technique in classification. In most cases, FS can improve classification accuracy and reduce feature dimension, so it can be regarded as a multi-objective optimization problem. Many evolutionary computation techniques have been applied to FS problems and achieved good results. However, an increase in data dimension means that search difficulty also greatly increases, and EC algorithms with insufficient search ability maybe only find sub-optimal solutions in high probability. Moreover, an improper initial population may negatively affect the convergence speed of algorithms. To solve the problems highlighted above, this paper proposes MOEA-ISa: a multi-objective evolutionary algorithm with interval based initialization and self-adaptive crossover operator for large-scale FS. The proposed interval based initialization can limit the number of selected features for solution to improve the distribution of the initial population in the target space and reduce the similarity of the initial population in the decision space. The proposed self-adaptive crossover operator can determine the number of nonzero genes in offspring according to the similarity of parents, and it combines with the feature weights obtained by ReliefF method to improve the quality of offspring. In the experiments, the proposed algorithm was compared with six other algorithms on 13 benchmark UCI datasets and two benchmark LIBSVM datasets, and an ablation experiment was performed on MOEA-ISa. The results show that MOEA-ISa’s performance is better than the six other algorithms for solving large-scale FS problems, and the proposed interval based initialization and self-adaptive crossover operator can effectively improve the performance of MOEA-ISa. The source code of MOEA-ISa is available on GitHub at https://github.com/xueyunuist/MOEA-ISa.

A Survey on Evolutionary Multiobjective Feature Selection in Classification: Approaches, Applications, and Challenges

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

An Evolutionary Multitasking-Based Feature Selection Method for High-Dimensional Classification

A self-adaptive multi-objective feature selection approach for classification problems

An evolutionary multi-objective optimization framework of discretization-based feature selection for classification

Surrogate-Assisted Flip for Evolutionary High-Dimensional Multiobjective Feature Selection.

A multi-objective feature selection approach based on chemical reaction optimization

Evolutionary Computation for Feature Selection in Classification: A Comprehensive Survey of Solutions, Applications and Challenges

A Survey on Evolutionary Computation Approaches to Feature Selection

Multiobjective Differential Evolution for Feature Selection in Classification

A Joint Multiobjective Optimization of Feature Selection and Classifier Design for High-Dimensional Data Classification

A Multi-objective Feature Selection Method Considering the Interaction Between Features

MOFSRank: A Multiobjective Evolutionary Algorithm for Feature Selection in Learning to Rank

A Survey on Search Strategy of Evolutionary Multi-Objective Optimization Algorithms

Information Gain-based Multi-objective Evolutionary Algorithm for Feature Selection

A multi-objective evolutionary algorithm with interval based initialization and self-adaptive crossover operator for large-scale feature selection in classification

MPEA-FS: A decomposition-based multi-population evolutionary algorithm for high-dimensional feature selection

Multiobjective Optimization Algorithm with Dynamic Operator Selection for Feature Selection in High-Dimensional Classification

Evolutionary Multitasking for Feature Selection in High-Dimensional Classification Via Particle Swarm Optimization

A Variable Granularity Search-Based Multiobjective Feature Selection Algorithm for High-Dimensional Data Classification

A Multi-Task Decomposition-Based Evolutionary Algorithm for Tackling High-Dimensional Bi-Objective Feature Selection