Abstract:To efficiently deal with high-dimensional datasets in many areas, unsupervised feature selection (UFS) has become a rising technique for dimension reduction. Even though there are many UFS methods, most of them only consider the global structure of datasets by embedding a single sparse regularization or constraint. In this paper, we introduce a novel bi-sparse UFS method, called BSUFS, to simultaneously characterize both global and local structures. The core idea of BSUFS is to incorporate $\ell_{2,p}$-norm and $\ell_q$-norm into the classical principal component analysis (PCA), which enables our proposed method to select relevant features and filter out irrelevant noise accurately. Here, the parameters $p$ and $q$ are within the range of [0,1). Therefore, BSUFS not only constructs a unified framework for bi-sparse optimization, but also includes some existing works as special cases. To solve the resulting non-convex model, we propose an efficient proximal alternating minimization (PAM) algorithm using Riemannian manifold optimization and sparse optimization techniques. Theoretically, PAM is proven to have global convergence, i.e., for any random initial point, the generated sequence converges to a critical point that satisfies the first-order optimality condition. Extensive numerical experiments on synthetic and real-world datasets demonstrate the effectiveness of our proposed BSUFS. Specifically, the average accuracy (ACC) is improved by at least 4.71% and the normalized mutual information (NMI) is improved by at least 3.14% on average compared to the existing UFS competitors. The results validate the advantages of bi-sparse optimization in feature selection and show its potential for other fields in image processing. Our code will be available at <a class="link-external link-https" href="https://github.com/xianchaoxiu" rel="external noopener nofollow">this https URL</a>.

Sparse Representation-Based Approach for Unsupervised Feature Selection

Unsupervised Feature Selection Algorithm Based on Sparse Representation

Sparsity Preserving Score for Joint Feature Selection

Sparse Representation Preserving for Unsupervised Feature Selection

Feature Selection in Face Recognition: A Sparse Representation Perspective

Unsupervised Feature Selection Based on Locality Preserving Projection and Sparse Representation

UDSFS: Unsupervised Deep Sparse Feature Selection

Unsupervised Feature Selection Based on Self-Representation Sparse Regression and Local Similarity Preserving

Sparse Graph Embedding Unsupervised Feature Selection.

Graph Self-Representation Method for Unsupervised Feature Selection

Low-rank Unsupervised Graph Feature Selection Via Feature Self-Representation.

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

Sparse Preserving Feature Weights Learning.

A Survey on Sparse Learning Models for Feature Selection

Supervised Sparsity Preserving Projections for Face Recognition.

Semi-Supervised Feature Selection Via Sparse Rescaled Linear Square Regression.

Unsupervised Feature Selection by Regularized Self-Representation.

Unsupervised Feature Selection Via Local Structure Learning and Sparse Learning

Unsupervised Feature Selection for Visual Classification Via Feature-Representation Property

Feature Selection Based on Structured Sparsity: A Comprehensive Study.

Bi-Sparse Unsupervised Feature Selection