Abstract:Recently, when handling high-dimensional data, it has become extremely difficult to search this optimal subset of selected features due to the restriction of reducing the exponential increase of the search procedure, and most of those feature selection models neglect the interactions of features or feature and decision class. This paper develops a novel feature selection approach using symmetric uncertainty and hybrid optimization for high-dimensional data (FSUHO) for high-dimensional data. First, to fully reflect the interaction relationship of features or feature and decision class, the F-relevance between features and the C-correlation between feature and decision class based on the symmetric uncertainty are constructed to remove those redundant features. Then, a strong correlation threshold is improved based on the C-correlation and random coefficient to prevent the removal of the effective features in this first stage. Second, to decrease this expensive computational consumption, one criterion for judging a weakly correlated feature is designed to sort all features, and another criterion is developed to select the class center. The similarity between features and class centers is calculated, and similar features are clustered into one class. Then, the symmetric uncertainty correlation-based feature clustering model can be constructed in this second stage. In the third stage, a hybrid optimization approach of particle swarm optimizer (PSO) and wild horse optimizer (WHO) for feature selection is proposed, where the association-guided group initialization probability with a multiobjective optimized particle selection scheme is defined as a criterion for the PSO in selecting stallion particles for the WHO, and the improved WHO is developed by integrating the nonlinear inertial weight factor and the Brownian motion operator to obtain the optimal subset of selected features. Finally, a novel three-stage feature selection algorithm is developed. Experimental results apply to 16 datasets prove the efficiency of FSUHO in tackling high-dimensional feature selection problems in metrics of classification accuracy and running time.

An Interactive Feature Selection Method Based on Multi-Step State Transition Algorithm for High-Dimensional Data

A Hybrid Feature Selection Method Based on Binary State Transition Algorithm and ReliefF

A New Hybrid Filter/wrapper Algorithm for Feature Selection in Classification.

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A novel hybrid wrapper–filter approach based on genetic algorithm, particle swarm optimization for feature subset selection

MetaFS: An Effective Wrapper Feature Selection via Meta Learning

A multiple surrogate-assisted hybrid evolutionary feature selection algorithm

A hybrid Harris Hawks optimization algorithm with simulated annealing for feature selection

An evolutionary multi-objective optimization framework of discretization-based feature selection for classification

A Hybrid Feature Selection Algorithm and Its Application in Bioinformatics

A Two-Phase Feature Selection Method Using Both Filter and Wrapper

Search Space Division Method for Wrapper Feature Selection on High-Dimensional Data Classification

Feature Selection Boosted by Unselected Features.

Feature selection using symmetric uncertainty and hybrid optimization for high-dimensional data

A Novel Hybrid Algorithm for Feature Selection

Hybrid filter-wrapper feature selection for short-term load forecasting.

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

Py_FS: A Python Package for Feature Selection Using Meta-Heuristic Optimization Algorithms

New Feature Selection Paradigm Based On Hyper-Heuristic Technique

A Contrast Based Feature Selection Algorithm for High-dimensional Data set in Machine Learning

Unsupervised feature selection via multi-step markov probability relationship