Abstract:Feature selection has been widely used in classification for improving classification accuracy and reducing computational complexity. Recently, evolutionary computation (EC) has become an important approach for solving feature selection problems. However, firstly, as the datasets processed by classifiers become increasingly large and complex, more and more irrelevant and redundant features may exist and there may be more local optima in the large-scale feature space. Therefore, traditional EC algorithms which have only one candidate solution generation strategy (CSGS) with fixed parameter values may not perform well in searching for the optimal feature subsets for large-scale feature selection problems. Secondly, many existing studies usually use only one classifier to evaluate feature subsets. To show the effectiveness of evolutionary algorithms for feature selection problems, more classifiers should be tested. Thus, in order to efficiently solve large-scale feature selection problems and to show whether the EC-based feature selection method is efficient for more classifiers, a self-adaptive parameter and strategy based particle swarm optimization (SPS-PSO) algorithm is proposed in this paper using multiple classifiers. In SPS-PSO, a representation scheme of solutions and five CSGSs have been used. To automatically adjust the CSGSs and their parameter values during the evolutionary process, a strategy self-adaptive mechanism and a parameter self-adaptive mechanism are employed in the framework of particle swarm optimization (PSO). By using the self-adaptive mechanisms, the SPS-PSO can adjust both CSGSs and their parameter values when solving different large-scale feature selection problems. Therefore, SPS-PSO has good global and local search ability when dealing with these large-scale problems. Moreover, four classifiers, i.e., k-nearest neighbor (KNN), linear discriminant analysis (LDA), extreme learning machine (ELM), and support vector machine (SVM), are individually used as the evaluation functions for testing the effectiveness of feature subsets generated by SPS-PSO. Nine datasets from the UCI Machine Learning Repository and Causality Workbench are used in the experiments. All the nine datasets have more than 600 dimensions, and two of them have more than 5,000 dimensions. The experimental results show that the strategy and parameter self-adaptive mechanisms can improve the performance of the evolutionary algorithms, and that SPS-PSO can achieve higher classification accuracy and obtain more concise solutions than those of the other algorithms on the large-scale feature problems selected in this research. In addition, feature selection can improve the classification accuracy and reduce computational time for various classifiers. Furthermore, KNN is a better surrogate model compared with the other classifiers used in these experiments.

Classification Based on Brain Storm Optimization With Feature Selection

Structure and weights search for classification with feature selection based on brain storm optimization algorithm

Classification Based on Brain Storm Optimization Algorithm.

An Evolutionary Classification Method Based on Fireworks Algorithm

Feature Selection for High-Dimensional Classification Using a Competitive Swarm Optimizer.

An Evolutionary Multitasking-Based Feature Selection Method for High-Dimensional Classification

Evolutionary Feature Selection Based on Hybrid Bald Eagle Search and Particle Swarm Optimization

Self-adaptive parameter and strategy based particle swarm optimization for large-scale feature selection problems with multiple classifiers

An evolutionary multi-objective optimization framework of discretization-based feature selection for classification

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

Improved Brain Storm Optimization Algorithm Based on Flock Decision Mutation Strategy

Advanced discussion mechanism-based brain storm optimization algorithm

An Improved Brain Storm Optimization with Differential Evolution Strategy for Applications of ANNs

A Hybrid Initialization and Effective Reproduction-Based Evolutionary Algorithm for Tackling Bi-Objective Large-Scale Feature Selection in Classification

Evolutionary Multitasking for Feature Selection in High-Dimensional Classification Via Particle Swarm Optimization

Evolutionary Computation for Feature Selection in Classification: A Comprehensive Survey of Solutions, Applications and Challenges

Brain Storm Optimization Algorithm Based on Competition Mechanism.

A Constrained Competitive Swarm Optimizer With an SVM-Based Surrogate Model for Feature Selection

A Multiobjective Brain Storm Optimization Algorithm Based on Decomposition

An Improved Brain Storm Optimization with Dynamic Clustering Strategy

Multi-Objective Optimization Based on Brain Storm Optimization Algorithm