Abstract:Feature selection, as a crucial pre-processing stage in expert and intelligent systems, aims at reducing the dimensionality of the high-dimensional data by selecting the optimal subset from original features set. It can enhance the interpretability, improve learning performance, and increase computational efficiency. In real-world applications, obtaining class labels of data is time consuming and labor intensive, thus unsupervised feature selection is more practically important but correspondingly more challenging. Self-representation learning provides some insights on unsupervised feature selection, whose goal is to identify a representative feature subset so that all the features can be well reconstructed by them. In this paper, we propose a new unsupervised feature selection method by using NOn-conVex Regularized Self-Representation (NOVRSR). Different from most prior researches resorting to pseudo labels of data, NOVRSR exploits importance and relevance of features by self-representation. Moreover, the <math>ℓ2,1-2</math> sparse regularization, which is non-convex yet Lipschitz continuous, is enforced on the representation coefficient matrix to perform feature selection. We show in theory that the utilization of <math>ℓ2,1-2</math> can guarantee the sparsity of the representation coefficient matrix. In addition, to find the solution of the resulting non-convex formula, we design an iterative algorithm in the framework of ConCave-Convex Procedure (CCCP) and prove that the iterative sequence converges to the stationary point satisfying the first-order optimality condition. An adopted Alternating Direction Method of Multipliers (ADMM) is embedded to solve the sequence of convex subproblems of CCCP efficiently. Extensive experimental studies on real-world datasets demonstrate that the effectiveness of the proposed method.

Robust Unsupervised Feature Selection Based on Sparse Reconstruction of Learned Clean Data

Robust Feature Selection Method Via Joint Low-Rank Reconstruction and Projection Reconstruction

Semi-supervised feature selection based on structure and constraints preserving

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Graph Regularized Feature Selection with Data Reconstruction

Unsupervised Feature Selection Via Joint Local Learning and Group Sparse Regression

Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

Robust autoencoder feature selector for unsupervised feature selection

Robust Neighborhood Embedding for Unsupervised Feature Selection.

Two-Dimensional Unsupervised Feature Selection via Sparse Feature Filter

Unsupervised feature extraction by low-rank and sparsity preserving embedding

Adaptive Unsupervised Feature Selection with Structure Regularization

Semisupervised Feature Selection With Sparse Discriminative Least Squares Regression

Efficient and Stable Unsupervised Feature Selection Based on Novel Structured Graph and Data Discrepancy Learning

Group Sparse Feature Selection on Local Learning Based Clustering.

Unsupervised feature selection by non-convex regularized self-representation

Double-Structured Sparsity Guided Flexible Embedding Learning for Unsupervised Feature Selection

Discriminative Sparse Subspace Learning and Its Application to Unsupervised Feature Selection

Unsupervised feature selection by learning exponential weights