Abstract:Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel large-scale multi-objective evolutionary algorithm based on the search space shrinking, termed LMSSS, to tackle the challenges of feature selection particularly as a sparse optimization problem. The method includes a shrinking scheme to reduce dimensionality of the search space by eliminating irrelevant features before the main evolutionary process. This is achieved through a ranking-based filtering method that evaluates features based on their correlation with class labels and frequency in an initial, cost-effective evolutionary process. Additionally, a smart crossover scheme based on voting between parent solutions is introduced, giving higher weight to the parent with better classification accuracy. An intelligent mutation process is also designed to target features prematurely excluded from the population, ensuring they are evaluated in combination with other features. These integrated techniques allow the evolutionary process to explore the search space more efficiently and effectively, addressing the sparse and high-dimensional nature of large-scale feature selection problems. The effectiveness of the proposed algorithm is demonstrated through comprehensive experiments on 15 large-scale datasets, showcasing its potential to identify more accurate feature subsets compared to state-of-the-art large-scale feature selection algorithms. These results highlight LMSSS's capability to improve model performance and computational efficiency, setting a new benchmark in the field.

BSSReduce an $O(left|U ight|)$ Incremental Feature Selection Approach for Large-Scale and High-Dimensional Data

BSSReduce an $o(\left|u\right|)$ Incremental Feature Selection Approach for Large-Scale and High-Dimensional Data

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Towards Ultrahigh Dimensional Feature Selection for Big Data

A Contrast Based Feature Selection Algorithm for High-dimensional Data set in Machine Learning

Large-Scale Online Feature Selection for Ultra-High Dimensional Sparse Data.

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Online Feature Selection for Mining Big Data

Challenges of Feature Selection for Big Data Analytics

Parallel Selector for Feature Reduction

Ultra High-Dimensional Nonlinear Feature Selection for Big Biological Data

Incremental feature selection approach to multi-dimensional variation based on matrix dominance conditional entropy for ordered data set

Large-scale Multi-objective Feature Selection: A Multi-phase Search Space Shrinking Approach

Consistent Matrix: A Feature Selection Framework for Large-Scale Data Sets

Feature Selection Based on Rough Sets and Minimal Attribute Reduction Algorithm

Scalable and Accurate Online Feature Selection for Big Data

Incremental feature selection based on fuzzy rough sets

Size Adaptive Selection of Most Informative Features

A Feature Selection Method Based on Sparse Regularization Deep Neural Network

A fusion of centrality and correlation for feature selection

A Distributed Integrated Feature Selection Scheme for Column Subset Selection