Abstract:In this paper, a new feature selection algorithm, called SFE (Simple, Fast, and Efficient), is proposed for high-dimensional datasets. The SFE algorithm performs its search process using a search agent and two operators: non-selection and selection. It comprises two phases: exploration and exploitation. In the exploration phase, the non-selection operator performs a global search in the entire problem search space for the irrelevant, redundant, trivial, and noisy features, and changes the status of the features from selected mode to non-selected mode. In the exploitation phase, the selection operator searches the problem search space for the features with a high impact on the classification results, and changes the status of the features from non-selected mode to selected mode. The proposed SFE is successful in feature selection from high-dimensional datasets. However, after reducing the dimensionality of a dataset, its performance cannot be increased significantly. In these situations, an evolutionary computational method could be used to find a more efficient subset of features in the new and reduced search space. To overcome this issue, this paper proposes a hybrid algorithm, SFE-PSO (particle swarm optimization) to find an optimal feature subset. The efficiency and effectiveness of the SFE and the SFE-PSO for feature selection are compared on 40 high-dimensional datasets. Their performances were compared with six recently proposed feature selection algorithms. The results obtained indicate that the two proposed algorithms significantly outperform the other algorithms, and can be used as efficient and effective algorithms in selecting features from high-dimensional datasets.

A Fast SVM-based Feature Selection Method

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

A Novel Feature Selection Method Based on Extreme Learning Machine and Fractional-Order Darwinian PSO.

A comprehensive unsupervised feature selection method of two-stage strategy

Novel Linear Search for Support Vector Machine Parameter Selection

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

Fast instance selection method for SVM training based on fuzzy distance metric

A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters

A Fast Wrapper Feature Subset Selection Method Based on Binary Particle Swarm Optimization.

Fast extraction strategy of support vector machines

Support Vector Machine-Recursive Feature Elimination for Localized Feature Selection

Simultaneous Feature Selection and SVM Parameter by Using Artificial Bee Colony Algorithm

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

A Constrained Competitive Swarm Optimizer With an SVM-Based Surrogate Model for Feature Selection

Feature selection using bare-bones particle swarm optimization with mutual information

SFE: A Simple, Fast and Efficient Feature Selection Algorithm for High-Dimensional Data

Feature Selection Method Combing Improved F-score and Support Vector Machine