Abstract:To efficiently deal with high-dimensional datasets in many areas, unsupervised feature selection (UFS) has become a rising technique for dimension reduction. Even though there are many UFS methods, most of them only consider the global structure of datasets by embedding a single sparse regularization or constraint. In this paper, we introduce a novel bi-sparse UFS method, called BSUFS, to simultaneously characterize both global and local structures. The core idea of BSUFS is to incorporate $\ell_{2,p}$-norm and $\ell_q$-norm into the classical principal component analysis (PCA), which enables our proposed method to select relevant features and filter out irrelevant noise accurately. Here, the parameters $p$ and $q$ are within the range of [0,1). Therefore, BSUFS not only constructs a unified framework for bi-sparse optimization, but also includes some existing works as special cases. To solve the resulting non-convex model, we propose an efficient proximal alternating minimization (PAM) algorithm using Riemannian manifold optimization and sparse optimization techniques. Theoretically, PAM is proven to have global convergence, i.e., for any random initial point, the generated sequence converges to a critical point that satisfies the first-order optimality condition. Extensive numerical experiments on synthetic and real-world datasets demonstrate the effectiveness of our proposed BSUFS. Specifically, the average accuracy (ACC) is improved by at least 4.71% and the normalized mutual information (NMI) is improved by at least 3.14% on average compared to the existing UFS competitors. The results validate the advantages of bi-sparse optimization in feature selection and show its potential for other fields in image processing. Our code will be available at <a class="link-external link-https" href="https://github.com/xianchaoxiu" rel="external noopener nofollow">this https URL</a>.

Self-paced regularized adaptive multi-view unsupervised feature selection

Structural Regularization Based Discriminative Multi-View Unsupervised Feature Selection

Clean Affinity Matrix Induced Hyper-Laplacian Regularization for Unsupervised Multi-View Feature Selection

Multi-View Unsupervised Feature Selection with Adaptive Similarity and View Weight

Adaptive unsupervised multi-view feature selection for visual concept recognition

Generalized Multi-View Unsupervised Feature Selection

Adaptive Similarity Embedding for Unsupervised Multi-View Feature Selection

Tensor-based unsupervised feature selection for error-robust handling of unbalanced incomplete multi-view data

Unified View Imputation and Feature Selection Learning for Incomplete Multi-view Data

Multilevel projections with adaptive neighbor graph for unsupervised multi-view feature selection

High-order correlation preserved multi-view unsupervised feature selection

Efficient Multi-view Unsupervised Feature Selection with Adaptive Structure Learning and Inference

Sparse robust multiview feature selection via adaptive-weighting strategy

Unsupervised Cross-View Feature Selection on incomplete data

Consensus Learning Guided Multi-View Unsupervised Feature Selection

Bi-Sparse Unsupervised Feature Selection

Supervised Multiview Feature Selection Exploring Homogeneity and Heterogeneity with $\ell_{1,2}$ -Norm and Automatic View Generation

Robust Re-Weighted Multi-View Feature Selection

Efficient multi-view semi-supervised feature selection

Semi-Supervised Multiview Feature Selection With Adaptive Graph Learning

Multi-view Dimensionality Reduction Learning with Hierarchical Sparse Feature Selection