Abstract:Unsupervised feature selection (UFS) is widely applied in machine learning and pattern recognition. However, most of the existing methods only consider a single sparsity, which makes it difficult to select valuable and discriminative feature subsets from the original high-dimensional feature set. In this paper, we propose a new UFS method called DSCOFS via embedding double sparsity constrained optimization into the classical principal component analysis (PCA) framework. Double sparsity refers to using $\ell_{2,0}$-norm and $\ell_0$-norm to simultaneously constrain variables, by adding the sparsity of different types, to achieve the purpose of improving the accuracy of identifying differential features. The core is that $\ell_{2,0}$-norm can remove irrelevant and redundant features, while $\ell_0$-norm can filter out irregular noisy features, thereby complementing $\ell_{2,0}$-norm to improve discrimination. An effective proximal alternating minimization method is proposed to solve the resulting nonconvex nonsmooth model. Theoretically, we rigorously prove that the sequence generated by our method globally converges to a stationary point. Numerical experiments on three synthetic datasets and eight real-world datasets demonstrate the effectiveness, stability, and convergence of the proposed method. In particular, the average clustering accuracy (ACC) and normalized mutual information (NMI) are improved by at least 3.34% and 3.02%, respectively, compared with the state-of-the-art methods. More importantly, two common statistical tests and a new feature similarity metric verify the advantages of double sparsity. All results suggest that our proposed DSCOFS provides a new perspective for feature selection.

Rethinking Embedded Unsupervised Feature Selection: A Simple Joint Approach

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Unsupervised Feature Selection with Joint Clustering Analysis.

Subspace Clustering Guided Unsupervised Feature Selection.

UDSFS: Unsupervised Deep Sparse Feature Selection

Joint Anchor Graph Embedding and Discrete Feature Scoring for Unsupervised Feature Selection.

Symmetrical Self-representation and Data-grouping Strategy for Unsupervised Feature Selection

A New Unsupervised Feature Selection Algorithm Using Similarity-Based Feature Clustering.

A Novel Unsupervised Feature Selection for High-Dimensional Data Based on FCM and $k$ -Nearest Neighbor Rough Sets

Co-regularized Unsupervised Feature Selection

Dependence Guided Unsupervised Feature Selection

Enhancing Unsupervised Feature Selection via Double Sparsity Constrained Optimization

Coupled Dictionary Learning for Unsupervised Feature Selection.

Simultaneous local clustering and unsupervised feature selection via strong space constraint

Unsupervised feature selection for multi-cluster data

Generalized Multi-View Unsupervised Feature Selection

Double-Structured Sparsity Guided Flexible Embedding Learning for Unsupervised Feature Selection

Feature Selection Boosted by Unselected Features.

K-means Derived Unsupervised Feature Selection using Improved ADMM

An Efficient Framework for Unsupervised Feature Selection