Abstract:Unsupervised feature selection (UFS) is widely applied in machine learning and pattern recognition. However, most of the existing methods only consider a single sparsity, which makes it difficult to select valuable and discriminative feature subsets from the original high-dimensional feature set. In this paper, we propose a new UFS method called DSCOFS via embedding double sparsity constrained optimization into the classical principal component analysis (PCA) framework. Double sparsity refers to using $\ell_{2,0}$-norm and $\ell_0$-norm to simultaneously constrain variables, by adding the sparsity of different types, to achieve the purpose of improving the accuracy of identifying differential features. The core is that $\ell_{2,0}$-norm can remove irrelevant and redundant features, while $\ell_0$-norm can filter out irregular noisy features, thereby complementing $\ell_{2,0}$-norm to improve discrimination. An effective proximal alternating minimization method is proposed to solve the resulting nonconvex nonsmooth model. Theoretically, we rigorously prove that the sequence generated by our method globally converges to a stationary point. Numerical experiments on three synthetic datasets and eight real-world datasets demonstrate the effectiveness, stability, and convergence of the proposed method. In particular, the average clustering accuracy (ACC) and normalized mutual information (NMI) are improved by at least 3.34% and 3.02%, respectively, compared with the state-of-the-art methods. More importantly, two common statistical tests and a new feature similarity metric verify the advantages of double sparsity. All results suggest that our proposed DSCOFS provides a new perspective for feature selection.

Double-Structured Sparsity Guided Flexible Embedding Learning for Unsupervised Feature Selection

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

UDSFS: Unsupervised Deep Sparse Feature Selection

Sparse and Flexible Projections for Unsupervised Feature Selection

Enhancing Unsupervised Feature Selection via Double Sparsity Constrained Optimization

Sparse Graph Embedding Unsupervised Feature Selection.

Joint Adaptive Graph and Structured Sparsity Regularization for Unsupervised Feature Selection

Dual-graph regularized subspace learning based feature selection

Discriminative Sparse Subspace Learning and Its Application to Unsupervised Feature Selection

Sparse Feature Selection Via Fast Embedding Spectral Analysis

Discriminative Feature Selection Via A Structured Sparse Subspace Learning Module

Feature Selection Via Joint Embedding Learning and Sparse Regression

Pseudo-Label Guided Structural Discriminative Subspace Learning for Unsupervised Feature Selection.

Two-Dimensional Unsupervised Feature Selection via Sparse Feature Filter

Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection

Subspace Sparse Discriminative Feature Selection

Structured Learning for Unsupervised Feature Selection with High-Order Matrix Factorization

Simultaneous local clustering and unsupervised feature selection via strong space constraint

Unsupervised Feature Selection Via Collaborative Embedding Learning

Unsupervised Feature Selection with Constrained ℓ₂,₀-Norm and Optimized Graph

Dependence Guided Unsupervised Feature Selection