Abstract:In today's data-driven digital culture, there is a critical demand for optimized solutions that essentially reduce operating expenses while attempting to increase productivity. The amount of memory and processing time that can be used to process enormous volumes of data are subject to a number of limitations. This would undoubtedly be more of a problem if a dataset contained redundant and uninteresting information. For instance, many datasets contain a number of non-informative features that primarily deceive a given classification algorithm. In order to tackle this, researchers have been developing a variety of feature selection (FS) techniques that aim to eliminate unnecessary information from the raw datasets before putting them in front of a machine learning (ML) algorithm. Meta-heuristic optimization algorithms are often a solid choice to solve NP-hard problems like FS. In this study, we present a wrapper FS technique based on the sparrow search algorithm (SSA), a type of meta-heuristic. SSA is a swarm intelligence (SI) method that stands out because of its quick convergence and improved stability. SSA does have some drawbacks, like lower swarm diversity and weak exploration ability in late iterations, like the majority of SI algorithms. So, using ten chaotic maps, we try to ameliorate SSA in three ways: (i) the initial swarm generation; (ii) the substitution of two random variables in SSA; and (iii) clamping the sparrows crossing the search range. As a result, we get CSSA, a chaotic form of SSA. Extensive comparisons show CSSA to be superior in terms of swarm diversity and convergence speed in solving various representative functions from the Institute of Electrical and Electronics Engineers (IEEE) Congress on Evolutionary Computation (CEC) benchmark set. Furthermore, experimental analysis of CSSA on eighteen interdisciplinary, multi-scale ML datasets from the University of California Irvine (UCI) data repository, as well as three high-dimensional microarray datasets, demonstrates that CSSA outperforms twelve state-of-the-art algorithms in a classification task based on FS discipline. Finally, a 5%-significance-level statistical post-hoc analysis based on Wilcoxon's signed-rank test, Friedman's rank test, and Nemenyi's test confirms CSSA's significance in terms of overall fitness, classification accuracy, selected feature size, computational time, convergence trace, and stability.

Boosting SISSO Performance on Small Sample Datasets by Using Random Forests Prescreening for Complex Feature Selection

Facilitating Ferrous Oxide Prediction: Enabling Sintering Forecasting with Orthogonal Basis-Based Implicit Subspace Identification

i-SISSO: Mutual information-based improved sure independent screening and sparsifying operator algorithm

SISSO: A compressed-sensing method for identifying the best low-dimensional descriptor in an immensity of offered candidates

Boosting: An Ensemble Learning Tool for Compound Classification and QSAR Modeling

Improved Online Prediction of Silicon Content in Ironmaking Process Using Support Vector Regression with Novel Outlier Detection

RIFS2D: A two-dimensional version of a randomly restarted incremental feature selection algorithm with an application for detecting low-ranked biomarkers

RANDOM FOREST AND SUPPORT VECTOR MACHINE ON FEATURES SELECTION FOR REGRESSION ANALYSIS

Extracting random forest features with improved adaptive particle swarm optimization for industrial robot fault diagnosis

CURE-SMOTE algorithm and hybrid algorithm for feature selection and parameter optimization based on random forests

Improved salp swarm algorithm based on Newton interpolation and cosine opposition-based learning for feature selection

A Modified Sequential Deep Floating Search Algorithm For Feature Selection

Recursive Random Forests Enable Better Predictive Performance and Model Interpretation than Variable Selection by LASSO

Subsampling Winner Algorithm for Feature Selection in Large Regression Data

Random Forest Variable Importance-based Selection Algorithm in Class Imbalance Problem

Simultaneous SVM Parameters and Feature Selection Optimization Based on Improved Slime Mould Algorithm

Single Sample Feature Importance: An Interpretable Algorithm for Low-Level Feature Analysis

An Improvement to Feature Selection of Random Forests on Spark

An opposition-based social spider optimization for feature selection

Accelerated and Interpretable Oblique Random Survival Forests

A weighted-sum chaotic sparrow search algorithm for interdisciplinary feature selection and data classification