Abstract:To efficiently deal with high-dimensional datasets in many areas, unsupervised feature selection (UFS) has become a rising technique for dimension reduction. Even though there are many UFS methods, most of them only consider the global structure of datasets by embedding a single sparse regularization or constraint. In this paper, we introduce a novel bi-sparse UFS method, called BSUFS, to simultaneously characterize both global and local structures. The core idea of BSUFS is to incorporate $\ell_{2,p}$-norm and $\ell_q$-norm into the classical principal component analysis (PCA), which enables our proposed method to select relevant features and filter out irrelevant noise accurately. Here, the parameters $p$ and $q$ are within the range of [0,1). Therefore, BSUFS not only constructs a unified framework for bi-sparse optimization, but also includes some existing works as special cases. To solve the resulting non-convex model, we propose an efficient proximal alternating minimization (PAM) algorithm using Riemannian manifold optimization and sparse optimization techniques. Theoretically, PAM is proven to have global convergence, i.e., for any random initial point, the generated sequence converges to a critical point that satisfies the first-order optimality condition. Extensive numerical experiments on synthetic and real-world datasets demonstrate the effectiveness of our proposed BSUFS. Specifically, the average accuracy (ACC) is improved by at least 4.71% and the normalized mutual information (NMI) is improved by at least 3.14% on average compared to the existing UFS competitors. The results validate the advantages of bi-sparse optimization in feature selection and show its potential for other fields in image processing. Our code will be available at <a class="link-external link-https" href="https://github.com/xianchaoxiu" rel="external noopener nofollow">this https URL</a>.

Co-regularized Unsupervised Feature Selection

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Subspace Clustering Guided Unsupervised Feature Selection.

Coupled Dictionary Learning for Unsupervised Feature Selection.

Unsupervised Feature Selection by Regularized Matrix Factorization.

Robust Graph Regularized Unsupervised Feature Selection.

Discriminative and Uncorrelated Feature Selection with Constrained Spectral Analysis in Unsupervised Learning

Convex Non-Negative Matrix Factorization with Adaptive Graph for Unsupervised Feature Selection.

Simultaneous local clustering and unsupervised feature selection via strong space constraint

Half-Quadratic Minimization for Unsupervised Feature Selection on Incomplete Data.

Rethinking Embedded Unsupervised Feature Selection: A Simple Joint Approach

Unsupervised feature selection for multi-cluster data

Unsupervised Feature Selection Based on Self-Representation Sparse Regression and Local Similarity Preserving

Semi-supervised Uncorrelated Feature Selection

Bi-Sparse Unsupervised Feature Selection

Non-convex Regularized Self-Representation for Unsupervised Feature Selection

Robust Unsupervised Feature Selection Via Matrix Factorization

Generalized Multi-View Unsupervised Feature Selection

Unsupervised soft-label feature selection

Unsupervised Feature Selection via Nonnegative Orthogonal Constrained Regularized Minimization