Abstract:Feature selection has been widely used in classification for improving classification accuracy and reducing computational complexity. Recently, evolutionary computation (EC) has become an important approach for solving feature selection problems. However, firstly, as the datasets processed by classifiers become increasingly large and complex, more and more irrelevant and redundant features may exist and there may be more local optima in the large-scale feature space. Therefore, traditional EC algorithms which have only one candidate solution generation strategy (CSGS) with fixed parameter values may not perform well in searching for the optimal feature subsets for large-scale feature selection problems. Secondly, many existing studies usually use only one classifier to evaluate feature subsets. To show the effectiveness of evolutionary algorithms for feature selection problems, more classifiers should be tested. Thus, in order to efficiently solve large-scale feature selection problems and to show whether the EC-based feature selection method is efficient for more classifiers, a self-adaptive parameter and strategy based particle swarm optimization (SPS-PSO) algorithm is proposed in this paper using multiple classifiers. In SPS-PSO, a representation scheme of solutions and five CSGSs have been used. To automatically adjust the CSGSs and their parameter values during the evolutionary process, a strategy self-adaptive mechanism and a parameter self-adaptive mechanism are employed in the framework of particle swarm optimization (PSO). By using the self-adaptive mechanisms, the SPS-PSO can adjust both CSGSs and their parameter values when solving different large-scale feature selection problems. Therefore, SPS-PSO has good global and local search ability when dealing with these large-scale problems. Moreover, four classifiers, i.e., k-nearest neighbor (KNN), linear discriminant analysis (LDA), extreme learning machine (ELM), and support vector machine (SVM), are individually used as the evaluation functions for testing the effectiveness of feature subsets generated by SPS-PSO. Nine datasets from the UCI Machine Learning Repository and Causality Workbench are used in the experiments. All the nine datasets have more than 600 dimensions, and two of them have more than 5,000 dimensions. The experimental results show that the strategy and parameter self-adaptive mechanisms can improve the performance of the evolutionary algorithms, and that SPS-PSO can achieve higher classification accuracy and obtain more concise solutions than those of the other algorithms on the large-scale feature problems selected in this research. In addition, feature selection can improve the classification accuracy and reduce computational time for various classifiers. Furthermore, KNN is a better surrogate model compared with the other classifiers used in these experiments.

Particle swarm optimization based parameter selection technique for unsupervised discriminant analysis in transfer learning framework

Training support vector data descriptors using converging linear particle swarm optimization

Parameters Optimization of Deep Learning Models using Particle Swarm Optimization

Particle Swarm Optimization Based Multi-Task Parallel Reinforcement Learning Algorithm

Self-Tuned Discrimination-Aware Method for Unsupervised Feature Selection

Particle swarm optimization-based automatic parameter selection for deep neural networks and its applications in large-scale and high-dimensional data

Feature Selection Based on Adaptive Particle Swarm Optimization with Leadership Learning

An evolutionary feature selection method based on probability-based initialized particle swarm optimization

A Novel Feature-Selection Approach Based on Particle Swarm Optimization Algorithm for Intrusion Detection Systems (Workshop Paper)

Particle Swarm Optimization Based on Dimensional Learning Strategy

Feature Selection Using Double Parallel Feedforward Neural Networks And Particle Swarm Optimization

Evolutionary Multitasking Bi-Directional Particle Swarm Optimization for High-Dimensional Feature Selection

Learning Transferable Parameters for Unsupervised Domain Adaptation

Feature Selection of High Dimensional Data by Adaptive Potential Particle Swarm Optimization.

Pseudo-Label Guided Structural Discriminative Subspace Learning for Unsupervised Feature Selection.

Hyper-parameter selection in deep neural networks using parallel particle swarm optimization

PSO-PS: Parameter Synchronization with Particle Swarm Optimization for Distributed Training of Deep Neural Networks

A novel feature selection method based on adaptive search particle swarm optimization

Unsupervised Domain Adaptation for Image Classification and Object Detection Using Guided Transfer Learning Approach and JS Divergence

Self-adaptive parameter and strategy based particle swarm optimization for large-scale feature selection problems with multiple classifiers

A Supervised Particle Swarm Algorithm for Real-Parameter Optimization.