Abstract:Feature selection (FS) has been extensively employed in classification tasks to reduce data dimensionality and enhance prediction performance effectively. Recently, hybrid filter-wrapper methods have exhibited promising results in FS problems by leveraging both advantages. However, the inadequate integration of the filter method into the wrapper method leads to the hybrid algorithms exhibiting poor efficiency in classification as datasets grow in complexity. In this paper, an interactive feature selection framework based on state transition algorithm (STA) is proposed to address high-dimensional FS problems. In this framework, prior knowledge of the features is formed via the mutual information-based filter method. The STA is a powerful search engine that traverses the feature space in the wrapper stage. Moreover, an external trainer with prior knowledge will guide the exploration direction of STA in a simple but efficient way to accelerate the search process. And a self-adaptive mechanism is proposed to adjust the prior knowledge during the search process. Specifically, the external trainer establishes the interactive loop, while the self-adaptive mechanism aims to feed feature information back to the loop. In addition, the search process is prevented from being trapped in local optima by employing a multi-step STA, which allows for continuous transformations of the solution in probability. Finally, the proposed FS method is applied to various public classification datasets. The experimental results demonstrate that the proposed method is a highly competitive FS method, outperforming several state-of-the-art algorithms in generating an optimal subset of features.

D-FS: A Novel Integration Method of Discretization and Feature Selection

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

A Novel Algorithm for Dynamic Discretization of Continuous Features Based on Clustering

A novel hybrid feature selection method based on dynamic feature importance

A Hybrid Discretization And Feature Selection Method Based On Rough Sets For Evaluation

A Feature Selection Framework Based on Supervised Data Clustering

A New Methal Unsupervised Feature Selection for Text Mining

A Semi-supervised Method for Feature Selection

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Feature subset selection via an improved discretization-based particle swarm optimization

An Interactive Feature Selection Method Based on Multi-Step State Transition Algorithm for High-Dimensional Data

A novel discretization algorithm based on multi-scale and information entropy

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures

A Contrast Based Feature Selection Algorithm for High-dimensional Data set in Machine Learning

Feature Selection Using Hierarchical Feature Clustering

Fuzzy feature factorization machine: Bridging feature interaction, selection, and construction

Effective Learning with Joint Discriminative and Representative Feature Selection

A Modified Sequential Deep Floating Search Algorithm For Feature Selection

Efficient and Stable Unsupervised Feature Selection Based on Novel Structured Graph and Data Discrepancy Learning