Abstract:Dimensionality reduction is an important and challenging task in machine learning and data mining. Feature selection and feature extraction are two commonly used techniques for decreasing dimensionality of the data and increasing efficiency of learning algorithms. Specifically, feature selection realized in the absence of class labels, namely unsupervised feature selection, is challenging and interesting. In this paper, we propose a new unsupervised feature selection criterion developed from the viewpoint of subspace learning, which is treated as a matrix factorization problem. The advantages of this work are four-fold. First, dwelling on the technique of matrix factorization, a unified framework is established for feature selection, feature extraction and clustering. Second, an iterative update algorithm is provided via matrix factorization, which is an efficient technique to deal with high-dimensional data. Third, an effective method for feature selection with numeric data is put forward, instead of drawing support from the discretization process. Fourth, this new criterion provides a sound foundation for embedding kernel tricks into feature selection. With this regard, an algorithm based on kernel methods is also proposed. The algorithms are compared with four state-of-the-art feature selection methods using six publicly available datasets. Experimental results demonstrate that in terms of clustering results, the proposed two algorithms come with better performance than the others for almost all datasets we experimented with here.

Maximum Correntropy Criterion-Based Sparse Subspace Learning for Unsupervised Feature Selection

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Low-rank Unsupervised Graph Feature Selection Via Feature Self-Representation.

Unsupervised Feature Selection by Nonnegative Sparsity Adaptive Subspace Learning

Subspace Learning for Unsupervised Feature Selection Via Matrix Factorization.

Convex Sparse PCA for Unsupervised Feature Learning.

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

Unsupervised Feature Selection via Nonnegative Orthogonal Constrained Regularized Minimization

Discriminative Sparse Subspace Learning and Its Application to Unsupervised Feature Selection

Unsupervised Feature Selection Via Maximum Projection and Minimum Redundancy

Unsupervised Feature Analysis with Class Margin Optimization

Simultaneous local clustering and unsupervised feature selection via strong space constraint

Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection

KNCFS: Feature selection for high-dimensional datasets based on improved random multi-subspace learning

Soft Label Guided Unsupervised Discriminative Sparse Subspace Feature Selection

An Information-Theoretic Approach to Unsupervised Feature Selection for High-Dimensional Data

Semi-Supervised Feature Selection Via Sparse Rescaled Linear Square Regression.

Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection

Unsupervised Feature Selection Via Joint Local Learning and Group Sparse Regression