Abstract:Feature selection (FS) is an important data preprocessing technique that selects a small subset of relevant features to improve learning performance. However, it is also challenging due to its large search space. Recently, a competitive swarm optimizer (CSO) has shown promising results in FS because of its potential global search ability. The main idea of CSO is to select two solutions randomly and then let the loser (worse fitness) learn from the winner (better fitness). Although such a search mechanism provides a high population diversity, it is at risk of generating unqualified solutions since the winner’s quality is not guaranteed. In this work, we propose a constrained evolutionary mechanism for CSO, which verifies the quality of all the particles and lets the infeasible (unqualified) solutions learn from the feasible (qualified) ones. We also propose a novel local search and a size-change operator that guide the population to search for smaller feature subsets with similar or better classification performance. A surrogate model, based on support vector machines, is proposed to assist both local search and the size-change operator to explore a massive number of potential feature subsets without requiring excessive computational resource. Results on 24 real-world datasets show that the proposed algorithm can select smaller feature subsets with higher classification performance than state-of-the-art evolutionary computation (EC) and non-EC benchmark algorithms.

Swarm Intelligent Tuning Of One-Class V-Svm Parameters

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Novel Linear Search for Support Vector Machine Parameter Selection

A Method of Parameter Optimization for Particle Swarm Optimization Based on Stochastic Processes

Application of particle swarm optimization algorithm on robust PID controller tuning

Enhancing Particle Swarm Optimization via probabilistic models

Analysis and Simulation on a Class of Improved Swarm Optimizer

Parameter Identification of Nonlinear System Model Based on Bacterial Swarm Foraging for Optimization

Training support vector data descriptors using converging linear particle swarm optimization

Hyper-parameter tuning for support vector machine using an improved cat swarm optimization algorithm

Locating the Parameters of RBF Networks Using a Hybrid Particle Swarm Optimization Method

Quantum-Behaved Particle Swarm Optimization for Parameter Optimization of Support Vector Machine

A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters

Multi-objective parameters selection for SVM classification using NSGA-II

Parameter Optimization For Svm Using Sequential Number Theoretic For Optimization

Parameters optimization of support vector machines for imbalanced data using social ski driver algorithm

SVM Parameter Optimization using Grid Search and Genetic Algorithm to Improve Classification Performance

A PSO and Pattern Search based Memetic Algorithm for SVMs Parameters Optimization

A Constrained Competitive Swarm Optimizer With an SVM-Based Surrogate Model for Feature Selection

A Novel Hybrid Method of Parameters Tuning in Support Vector Regression for Reliability Prediction: Particle Swarm Optimization Combined With Analytical Selection