Abstract:Feature selection, as a crucial pre-processing stage in expert and intelligent systems, aims at reducing the dimensionality of the high-dimensional data by selecting the optimal subset from original features set. It can enhance the interpretability, improve learning performance, and increase computational efficiency. In real-world applications, obtaining class labels of data is time consuming and labor intensive, thus unsupervised feature selection is more practically important but correspondingly more challenging. Self-representation learning provides some insights on unsupervised feature selection, whose goal is to identify a representative feature subset so that all the features can be well reconstructed by them. In this paper, we propose a new unsupervised feature selection method by using NOn-conVex Regularized Self-Representation (NOVRSR). Different from most prior researches resorting to pseudo labels of data, NOVRSR exploits importance and relevance of features by self-representation. Moreover, the <math>ℓ2,1-2</math> sparse regularization, which is non-convex yet Lipschitz continuous, is enforced on the representation coefficient matrix to perform feature selection. We show in theory that the utilization of <math>ℓ2,1-2</math> can guarantee the sparsity of the representation coefficient matrix. In addition, to find the solution of the resulting non-convex formula, we design an iterative algorithm in the framework of ConCave-Convex Procedure (CCCP) and prove that the iterative sequence converges to the stationary point satisfying the first-order optimality condition. An adopted Alternating Direction Method of Multipliers (ADMM) is embedded to solve the sequence of convex subproblems of CCCP efficiently. Extensive experimental studies on real-world datasets demonstrate that the effectiveness of the proposed method.

Unsupervised Feature Selection for Visual Classification Via Feature-Representation Property

Low-rank Unsupervised Graph Feature Selection Via Feature Self-Representation.

Unsupervised Feature Selection by Regularized Self-Representation.

Graph Self-Representation Method for Unsupervised Feature Selection

Unsupervised feature selection by non-convex regularized self-representation

Non-convex Regularized Self-representation for Unsupervised Feature Selection.

Self-representation and PCA Embedding for Unsupervised Feature Selection

Non-convex Regularized Self-Representation for Unsupervised Feature Selection

Unsupervised Hypergraph Feature Selection with Low-Rank and Self-Representation Constraints

Unsupervised Feature Selection With Ordinal Preserving Self-Representation

Joint Self-Representation and Subspace Learning for Unsupervised Feature Selection.

Unsupervised Feature Selection Based on Self-Representation Sparse Regression and Local Similarity Preserving

Robust Unsupervised Feature Selection Via Dual Self-Representation and Manifold Regularization

Sparse Representation-Based Approach for Unsupervised Feature Selection

Unsupervised Feature Selection by Manifold Regularized Self-Representation.

Unsupervised Feature Selection Algorithm Based on Sparse Representation

Structure Preserving Non-Negative Feature Self-Representation for Unsupervised Feature Selection

Unsupervised Feature Selection Algorithm Based on Graph Filtering and Self-representation

Robust Dual-Graph Regularized and Minimum Redundancy Based on Self-Representation for Semi-Supervised Feature Selection

Unsupervised Feature Selection with Self-Weighted and ℓ2,0-Norm Constraint

Unsupervised Feature Selection Based on Locality Preserving Projection and Sparse Representation