Abstract:To efficiently deal with high-dimensional datasets in many areas, unsupervised feature selection (UFS) has become a rising technique for dimension reduction. Even though there are many UFS methods, most of them only consider the global structure of datasets by embedding a single sparse regularization or constraint. In this paper, we introduce a novel bi-sparse UFS method, called BSUFS, to simultaneously characterize both global and local structures. The core idea of BSUFS is to incorporate $\ell_{2,p}$-norm and $\ell_q$-norm into the classical principal component analysis (PCA), which enables our proposed method to select relevant features and filter out irrelevant noise accurately. Here, the parameters $p$ and $q$ are within the range of [0,1). Therefore, BSUFS not only constructs a unified framework for bi-sparse optimization, but also includes some existing works as special cases. To solve the resulting non-convex model, we propose an efficient proximal alternating minimization (PAM) algorithm using Riemannian manifold optimization and sparse optimization techniques. Theoretically, PAM is proven to have global convergence, i.e., for any random initial point, the generated sequence converges to a critical point that satisfies the first-order optimality condition. Extensive numerical experiments on synthetic and real-world datasets demonstrate the effectiveness of our proposed BSUFS. Specifically, the average accuracy (ACC) is improved by at least 4.71% and the normalized mutual information (NMI) is improved by at least 3.14% on average compared to the existing UFS competitors. The results validate the advantages of bi-sparse optimization in feature selection and show its potential for other fields in image processing. Our code will be available at <a class="link-external link-https" href="https://github.com/xianchaoxiu" rel="external noopener nofollow">this https URL</a>.

Sparse and Flexible Projections for Unsupervised Feature Selection

Joint Feature Selection and Extraction with Sparse Unsupervised Projection

Unsupervised Discriminative Projection for Feature Selection

Fast Orthogonal Locality-Preserving Projections for Unsupervised Feature Selection.

Feature Selective Projection with Low-Rank Embedding and Dual Laplacian Regularization

Unsupervised Feature Selection with Constrained ℓ₂,₀-Norm and Optimized Graph

Unsupervised Feature Selection with Flexible Optimal Graph

Sparse Representation Preserving for Unsupervised Feature Selection

Double-Structured Sparsity Guided Flexible Embedding Learning for Unsupervised Feature Selection

Unsupervised Feature Selection Based on Locality Preserving Projection and Sparse Representation

Enhancing Unsupervised Feature Selection via Double Sparsity Constrained Optimization

UDSFS: Unsupervised Deep Sparse Feature Selection

Unsupervised Feature Selection Algorithm Based on Sparse Representation

Bi-Sparse Unsupervised Feature Selection

Sparse Feature Selection Via Fast Embedding Spectral Analysis

Unsupervised Feature Selection with Self-Weighted and ℓ2,0-Norm Constraint

Unsupervised Feature Selection Based on Self-Representation Sparse Regression and Local Similarity Preserving

Unsupervised feature extraction by low-rank and sparsity preserving embedding

Fast Unsupervised Feature Selection with Bipartite Graph and l2,0-Norm Constraint

Graph Self-Representation Method for Unsupervised Feature Selection

Two-Dimensional Unsupervised Feature Selection via Sparse Feature Filter