Abstract:Recently, when handling high-dimensional data, it has become extremely difficult to search this optimal subset of selected features due to the restriction of reducing the exponential increase of the search procedure, and most of those feature selection models neglect the interactions of features or feature and decision class. This paper develops a novel feature selection approach using symmetric uncertainty and hybrid optimization for high-dimensional data (FSUHO) for high-dimensional data. First, to fully reflect the interaction relationship of features or feature and decision class, the F-relevance between features and the C-correlation between feature and decision class based on the symmetric uncertainty are constructed to remove those redundant features. Then, a strong correlation threshold is improved based on the C-correlation and random coefficient to prevent the removal of the effective features in this first stage. Second, to decrease this expensive computational consumption, one criterion for judging a weakly correlated feature is designed to sort all features, and another criterion is developed to select the class center. The similarity between features and class centers is calculated, and similar features are clustered into one class. Then, the symmetric uncertainty correlation-based feature clustering model can be constructed in this second stage. In the third stage, a hybrid optimization approach of particle swarm optimizer (PSO) and wild horse optimizer (WHO) for feature selection is proposed, where the association-guided group initialization probability with a multiobjective optimized particle selection scheme is defined as a criterion for the PSO in selecting stallion particles for the WHO, and the improved WHO is developed by integrating the nonlinear inertial weight factor and the Brownian motion operator to obtain the optimal subset of selected features. Finally, a novel three-stage feature selection algorithm is developed. Experimental results apply to 16 datasets prove the efficiency of FSUHO in tackling high-dimensional feature selection problems in metrics of classification accuracy and running time.

Structured Orthogonal Matching Pursuit for Feature Selection

Sparse Signals Recovery from Noisy Measurements by Orthogonal Matching Pursuit

Nonuniform Support Recovery from Noisy Random Measurements by Orthogonal Matching Pursuit.

A Feature Selection Method Based on Feature-Label Correlation Information and Self-Adaptive MOPSO

Sparse Subspace Clustering With One-Way Selective Orthogonal Matching Pursuit

A generalised OMP algorithm for feature selection with application to gene expression data

Orthogonal Matching Pursuit with Adaptive Restriction for Sparse Subspace Clustering

Improving the Correlation Lower Bound for Simultaneous Orthogonal Matching Pursuit

Adaptive Aggregative Multitask Competitive Particle Swarm Optimization with Bi-Directional Asymmetric Flip Strategy for High-Dimensional Feature Selection

Supervised Feature Subset Selection with Ordinal Optimization

Active Orthogonal Matching Pursuit for Sparse Subspace Clustering

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

A Two-Level Simultaneous Orthogonal Matching Pursuit Algorithm for Simultaneous Sparse Approximation Problems

Sparsity and incoherence in orthogonal matching pursuit

An improved feature selection method based on angle-guided multi-objective PSO and feature-label mutual information

Feature selection using symmetric uncertainty and hybrid optimization for high-dimensional data

An evolutionary feature selection method based on probability-based initialized particle swarm optimization

Restricted Connection Orthogonal Matching Pursuit For Sparse Subspace Clustering.

Multi-objective particle swarm optimization with adaptive strategies for feature selection

Iterative Orthogonal Matching Pursuit and Sparse Solution

Multilabel Feature Selection Via Shared Latent Sublabel Structure and Simultaneous Orthogonal Basis Clustering