Abstract:In this article, we propose a novel feature selection approach via explicitly addressing the long-standing subspace sparsity issue. Leveraging $\ell _{2,1}$ -norm regularization for feature selection is the major strategy in existing methods, which, however, confronts sparsity limitation and parameter-tuning trouble. To circumvent this problem, employing the $\ell _{2,0}$ -norm constraint to improve the sparsity of the model has gained more attention recently whereas, optimizing the subspace sparsity constraint is still an unsolved problem, which only can acquire an approximate solution and without convergence proof. To address the above challenges, we innovatively propose a novel subspace sparsity discriminative feature selection (S2DFS) method which leverages a subspace sparsity constraint to avoid tuning parameters. In addition, the trace ratio formulated objective function extremely ensures the discriminability of selected features. Most important, an efficient iterative optimization algorithm is presented to explicitly solve the proposed problem with a closed-form solution and strict convergence proof. To the best of our knowledge, such an optimization algorithm of solving the subspace sparsity issue is first proposed in this article, and a general formulation of the optimization algorithm is provided for improving the extensibility and portability of our method. Extensive experiments conducted on several high-dimensional text and image datasets demonstrate that the proposed method outperforms related state-of-the-art methods in pattern classification and image retrieval tasks.

A binary feature selection framework in kernel spaces

Feature Selection in a Kernel Space

TAKES: a fast method to select features in the kernel space.

Distance-Based Classifier Via the Kernel Trick.

Unsupervised Discriminative Feature Selection in a Kernel Space Via L2, 1-Norm Minimization.

Framework for Choice of Kernels

A dissimilarity based kernel space for support vector machines

A Unified Framework for Kernelization: the Empirical Kernel Feature Space

Correntropy Based Feature Selection Using Binary Projection

Kernel-OPBS Algorithm: A Nonlinear Feature Selection Method for Hyperspectral Imagery

Optimizing Kernel Function with Applications to Kernel Principal Analysis and Locality Preserving Projection for Feature Extraction.

Robust kernel discriminant analysis and its application to feature extraction and recognition

Sparse Feature Selection in Kernel Discriminant Analysis via Optimal Scoring

Kernel Alignment for Unsupervised Feature Selection via Matrix Factorization

Feature Selection Based on Kernel Pattern Similarity.

Subspace Sparse Discriminative Feature Selection

Kernel-view Based Discriminant Approach for Embedded Feature Extraction in High-Dimensional Space

<Bold>An Implementation Framework For Kernel Methods With High-Dimensional Patterns</Bold>

Binary Feature Mask Optimization for Feature Selection

Optimizing the Kernel in the Empirical Feature Space

A Joint Learning Framework for Optimal Feature Extraction and Multi-class SVM