Abstract:In recent years, wrapper-based feature selection (FS) using evolutionary algorithms has been widely studied due to its ability to search for and evaluate subsets of features based on populations. However, these methods often suffer from a high computational cost and a long computation time, mainly due to the process of evaluating the feature subsets according to the classification performance. In order to tackle this problem, this paper presents a feature library-assisted surrogate model (FL-SM), which aims to reduce the computational cost but maintain a good prediction accuracy. Unlike the existing surrogate models used in FS, the proposed method focuses on the feature level instead of the sample level: an FL is built by collecting the scores of all the features during the evolutionary search. Specifically, each solution (subset candidate) is pre-evaluated based on the FL using only simple operations to decide whether or not it deserves to be evaluated by the classifier, improving the efficiency of the FS algorithm. Meanwhile, because not evaluating a certain number of solutions may lead to inaccurate solution selection during the evolutionary search, dynamic individual selection criteria are proposed. In addition, an adaptive FL update operator is proposed to handle the dynamics of the evolved population; it ensures the real-time validity of the FL. Furthermore, we incorporate the proposed FL-SM into some state-of-the-art single-and multi-objective evolutionary FS methods. The experimental results on benchmark datasets show that with good flexibility and extendibility, FL-SM can effectively reduce the computational cost of wrapper-based FS and still obtain high-quality feature subsets. Among the five algorithms tested, the average computation time reduction was 34.87%; at the same time, there was no significant difference in the classification accuracy for 80% of the tests, and our method even improved the classification accuracy for 6% of the tests.& COPY; 2023 Elsevier B.V. All rights reserved.

A multiple surrogate-assisted hybrid evolutionary feature selection algorithm

Surrogate Sample-Assisted Particle Swarm Optimization for Feature Selection on High-Dimensional Data

A Surrogate-Assisted Evolutionary Feature Selection Algorithm with Parallel Random Grouping for High-Dimensional Classification

A multi-surrogate-assisted dual-layer ensemble feature selection algorithm

Feature library-assisted surrogate model for evolutionary wrapper-based feature selection and classification

Surrogate-Assisted Flip for Evolutionary High-Dimensional Multiobjective Feature Selection.

A Surrogate-Assisted Ensemble Particle Swarm Optimizer for Feature Selection Problems

A Fast Hybrid Feature Selection Based on Correlation-Guided Clustering and Particle Swarm Optimization for High-Dimensional Data

A Novel Hybrid Algorithm for Feature Selection

A Constrained Competitive Swarm Optimizer With an SVM-Based Surrogate Model for Feature Selection

An Interactive Feature Selection Method Based on Multi-Step State Transition Algorithm for High-Dimensional Data

A Hybrid Feature Selection Algorithm and Its Application in Bioinformatics

A novel hybrid wrapper–filter approach based on genetic algorithm, particle swarm optimization for feature subset selection

A Hybrid Feature Selection Algorithm: Combination of Symmetrical Uncertainty and Genetic Algorithms

Feature Selection with Multi-Objective Genetic Algorithm Based on a Hybrid Filter and the Symmetrical Complementary Coefficient

MPEA-FS: A decomposition-based multi-population evolutionary algorithm for high-dimensional feature selection

A New Hybrid Feature Selection Based on Multi-Filter Weights and Multi-Feature Weights

FG-HFS: A feature filter and group evolution hybrid feature selection algorithm for high-dimensional gene expression data

A hybrid Harris Hawks optimization algorithm with simulated annealing for feature selection

MetaFS: An Effective Wrapper Feature Selection via Meta Learning

A Surrogate-Assisted Evolutionary Algorithm with Random Feature Selection for Large-Scale Expensive Problems