Abstract:In today's data-driven digital culture, there is a critical demand for optimized solutions that essentially reduce operating expenses while attempting to increase productivity. The amount of memory and processing time that can be used to process enormous volumes of data are subject to a number of limitations. This would undoubtedly be more of a problem if a dataset contained redundant and uninteresting information. For instance, many datasets contain a number of non-informative features that primarily deceive a given classification algorithm. In order to tackle this, researchers have been developing a variety of feature selection (FS) techniques that aim to eliminate unnecessary information from the raw datasets before putting them in front of a machine learning (ML) algorithm. Meta-heuristic optimization algorithms are often a solid choice to solve NP-hard problems like FS. In this study, we present a wrapper FS technique based on the sparrow search algorithm (SSA), a type of meta-heuristic. SSA is a swarm intelligence (SI) method that stands out because of its quick convergence and improved stability. SSA does have some drawbacks, like lower swarm diversity and weak exploration ability in late iterations, like the majority of SI algorithms. So, using ten chaotic maps, we try to ameliorate SSA in three ways: (i) the initial swarm generation; (ii) the substitution of two random variables in SSA; and (iii) clamping the sparrows crossing the search range. As a result, we get CSSA, a chaotic form of SSA. Extensive comparisons show CSSA to be superior in terms of swarm diversity and convergence speed in solving various representative functions from the Institute of Electrical and Electronics Engineers (IEEE) Congress on Evolutionary Computation (CEC) benchmark set. Furthermore, experimental analysis of CSSA on eighteen interdisciplinary, multi-scale ML datasets from the University of California Irvine (UCI) data repository, as well as three high-dimensional microarray datasets, demonstrates that CSSA outperforms twelve state-of-the-art algorithms in a classification task based on FS discipline. Finally, a 5%-significance-level statistical post-hoc analysis based on Wilcoxon's signed-rank test, Friedman's rank test, and Nemenyi's test confirms CSSA's significance in terms of overall fitness, classification accuracy, selected feature size, computational time, convergence trace, and stability.

A Distributed Integrated Feature Selection Scheme for Column Subset Selection

Distributed Feature Selection for Big Data Using Fuzzy Rough Sets

RHDOFS: A Distributed Online Algorithm Towards Scalable Streaming Feature Selection

CDFSIP Feature Selection Algorithm Based on ADA-DPC

A Modified Sequential Deep Floating Search Algorithm For Feature Selection

BSSReduce an $O(left|U ight|)$ Incremental Feature Selection Approach for Large-Scale and High-Dimensional Data

Feature Selection with Discernibility and Independence Criteria

A Streaming Feature Selection Method Based on Dynamic Feature Clustering and Particle Swarm Optimization

BSSReduce an $o(\left|u\right|)$ Incremental Feature Selection Approach for Large-Scale and High-Dimensional Data

Spark Rough Hypercuboid Approach for Scalable Feature Selection

A dynamic stochastic search algorithm for high-dimensional optimization problems and its application to feature selection

Communication-efficient Estimation for Distributed Subset Selection

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Entropy based measure and its algorithms for scalable feature selection

Distributed Fuzzy Rough Set for Big Data Analysis in Cloud Computing.

A weighted-sum chaotic sparrow search algorithm for interdisciplinary feature selection and data classification

Dss: A Scalable and Efficient Stratified Sampling Algorithm for Large-Scale Datasets

SFE: A Simple, Fast and Efficient Feature Selection Algorithm for High-Dimensional Data

Distributed Feature Selection for Efficient Economic Big Data Analysis.

SMEM: A Subspace Merging Based Evolutionary Method for High-Dimensional Feature Selection

Feature ranking based consensus clustering for feature subset selection