Abstract:Feature selection, as a crucial pre-processing stage in expert and intelligent systems, aims at reducing the dimensionality of the high-dimensional data by selecting the optimal subset from original features set. It can enhance the interpretability, improve learning performance, and increase computational efficiency. In real-world applications, obtaining class labels of data is time consuming and labor intensive, thus unsupervised feature selection is more practically important but correspondingly more challenging. Self-representation learning provides some insights on unsupervised feature selection, whose goal is to identify a representative feature subset so that all the features can be well reconstructed by them. In this paper, we propose a new unsupervised feature selection method by using NOn-conVex Regularized Self-Representation (NOVRSR). Different from most prior researches resorting to pseudo labels of data, NOVRSR exploits importance and relevance of features by self-representation. Moreover, the <math>ℓ2,1-2</math> sparse regularization, which is non-convex yet Lipschitz continuous, is enforced on the representation coefficient matrix to perform feature selection. We show in theory that the utilization of <math>ℓ2,1-2</math> can guarantee the sparsity of the representation coefficient matrix. In addition, to find the solution of the resulting non-convex formula, we design an iterative algorithm in the framework of ConCave-Convex Procedure (CCCP) and prove that the iterative sequence converges to the stationary point satisfying the first-order optimality condition. An adopted Alternating Direction Method of Multipliers (ADMM) is embedded to solve the sequence of convex subproblems of CCCP efficiently. Extensive experimental studies on real-world datasets demonstrate that the effectiveness of the proposed method.

Unsupervised Feature Selection with Self-Weighted and ℓ2,0-Norm Constraint

Unsupervised Feature Selection with Ordinal Locality.

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Unsupervised feature selection by learning exponential weights

Unsupervised Feature Selection via Nonnegative Orthogonal Constrained Regularized Minimization

Two-Dimensional Unsupervised Feature Selection via Sparse Feature Filter

L2,1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning

Unsupervised feature selection method based on dual manifold learning and dual spatial latent representation

Unsupervised feature selection by non-convex regularized self-representation

Simultaneous local clustering and unsupervised feature selection via strong space constraint

Unsupervised feature selection via multiple graph fusion and feature weight learning

Unsupervised feature selection via discrete spectral clustering and feature weights

Exploiting Combination Effect for Unsupervised Feature Selection by l 2,0 Norm.

Unsupervised feature selection for multi-cluster data

Unsupervised Feature Selection Algorithm Based on Graph Filtering and Self-representation

A novel method of constrained feature selection by the measurement of pairwise constraints uncertainty

Unsupervised Feature Analysis with Class Margin Optimization

Double-Structured Sparsity Guided Flexible Embedding Learning for Unsupervised Feature Selection

Unsupervised feature selection with high-order similarity learning

Unsupervised Discriminative Feature Selection in a Kernel Space Via L2, 1-Norm Minimization.