Abstract:In this article, we propose a novel feature selection approach via explicitly addressing the long-standing subspace sparsity issue. Leveraging $\ell _{2,1}$ -norm regularization for feature selection is the major strategy in existing methods, which, however, confronts sparsity limitation and parameter-tuning trouble. To circumvent this problem, employing the $\ell _{2,0}$ -norm constraint to improve the sparsity of the model has gained more attention recently whereas, optimizing the subspace sparsity constraint is still an unsolved problem, which only can acquire an approximate solution and without convergence proof. To address the above challenges, we innovatively propose a novel subspace sparsity discriminative feature selection (S2DFS) method which leverages a subspace sparsity constraint to avoid tuning parameters. In addition, the trace ratio formulated objective function extremely ensures the discriminability of selected features. Most important, an efficient iterative optimization algorithm is presented to explicitly solve the proposed problem with a closed-form solution and strict convergence proof. To the best of our knowledge, such an optimization algorithm of solving the subspace sparsity issue is first proposed in this article, and a general formulation of the optimization algorithm is provided for improving the extensibility and portability of our method. Extensive experiments conducted on several high-dimensional text and image datasets demonstrate that the proposed method outperforms related state-of-the-art methods in pattern classification and image retrieval tasks.

Soft Label Guided Unsupervised Discriminative Sparse Subspace Feature Selection

Unsupervised soft-label feature selection

Pseudo-Label Guided Structural Discriminative Subspace Learning for Unsupervised Feature Selection.

Soft-label Guided Non-Negative Matrix Factorization for Unsupervised Feature Selection

Subspace Clustering Guided Unsupervised Feature Selection.

UDSFS: Unsupervised Deep Sparse Feature Selection

Discriminative Sparse Subspace Learning and Its Application to Unsupervised Feature Selection

Nonnegative Laplacian Embedding Guided Subspace Learning for Unsupervised Feature Selection.

Subspace Learning for Unsupervised Feature Selection Via Matrix Factorization.

Double-Structured Sparsity Guided Flexible Embedding Learning for Unsupervised Feature Selection

Subspace Sparse Discriminative Feature Selection

Dual-graph regularized subspace learning based feature selection

Discriminative and Uncorrelated Feature Selection with Constrained Spectral Analysis in Unsupervised Learning

Simultaneous local clustering and unsupervised feature selection via strong space constraint

Unsupervised Discriminative Projection for Feature Selection

Unsupervised Feature Selection by Nonnegative Sparsity Adaptive Subspace Learning

Dependence Guided Unsupervised Feature Selection

Joint Self-Representation and Subspace Learning for Unsupervised Feature Selection.

Adaptive Data Structure Regularized Multiclass Discriminative Feature Selection

Low-rank Unsupervised Graph Feature Selection Via Feature Self-Representation.

Sparse and Low-Redundant Subspace Learning-Based Dual-Graph Regularized Robust Feature Selection