Abstract:In this article, we propose a novel feature selection approach via explicitly addressing the long-standing subspace sparsity issue. Leveraging $\ell _{2,1}$ -norm regularization for feature selection is the major strategy in existing methods, which, however, confronts sparsity limitation and parameter-tuning trouble. To circumvent this problem, employing the $\ell _{2,0}$ -norm constraint to improve the sparsity of the model has gained more attention recently whereas, optimizing the subspace sparsity constraint is still an unsolved problem, which only can acquire an approximate solution and without convergence proof. To address the above challenges, we innovatively propose a novel subspace sparsity discriminative feature selection (S2DFS) method which leverages a subspace sparsity constraint to avoid tuning parameters. In addition, the trace ratio formulated objective function extremely ensures the discriminability of selected features. Most important, an efficient iterative optimization algorithm is presented to explicitly solve the proposed problem with a closed-form solution and strict convergence proof. To the best of our knowledge, such an optimization algorithm of solving the subspace sparsity issue is first proposed in this article, and a general formulation of the optimization algorithm is provided for improving the extensibility and portability of our method. Extensive experiments conducted on several high-dimensional text and image datasets demonstrate that the proposed method outperforms related state-of-the-art methods in pattern classification and image retrieval tasks.

A review of the current status and future directions of research on subspace clustering feature selection

Subspace Learning for Unsupervised Feature Selection Via Matrix Factorization.

A Survey for Study of Feature Selection Algorithms

Feature Selection Embedded Subspace Clustering

Feature Selection in Machine Learning: A New Perspective

Subspace Clustering Guided Unsupervised Feature Selection.

A Survey on Sparse Subspace Clustering

Subspace Sparse Discriminative Feature Selection

A Survey on High-Dimensional Subspace Clustering

Text Feature Selection Based on Class Subspace

A Survey on Sparse Learning Models for Feature Selection

Some Studies on Feature Selection for High Dimensional Data

Dual-graph regularized subspace learning based feature selection

Structure-Aware Subspace Clustering

Discriminative Sparse Subspace Learning and Its Application to Unsupervised Feature Selection

Clustering-based feature subset selection with analysis on the redundancy–complementarity dimension

Frequent Patterns-Based Subspace Clustering

Learning a Subspace for Clustering Via Pattern Shrinking

Research on Spectral Clustering Algorithms and Prospects

Low-rank Unsupervised Graph Feature Selection Via Feature Self-Representation.

Exploiting constraint inconsistence for dimension selection in subspace clustering: A semi-supervised approach