Abstract:With the rapid development of multimedia technology, massive unlabelled data with high dimensionality need to be processed. As a means of dimensionality reduction, unsupervised feature selection has been widely recognized as an important and challenging pre-step for many machine learning and data mining tasks. Traditional unsupervised feature selection algorithms usually assume that the data instances are identically distributed and there is no dependency between them. However, the data instances are not only associated with high dimensional features but also inherently interconnected with each other. Furthermore, the inevitable noises mixed in data could degenerate the performances of previous methods which perform feature selection in original data space. Without label information, the connection information between data instances can be exploited and could help select relevant features. In this work, we propose a robust unsupervised feature selection method which embeds the latent representation learning into feature selection. Instead of measuring the feature importances in original data space, the feature selection is carried out in the learned latent representation space which is more robust to noises. The latent representation is modelled by non-negative matrix factorization of the affinity matrix which explicitly reflects the relationships of data instances. Meanwhile, the local manifold structure of original data space is preserved by a graph based manifold regularization term in the transformed feature space. An efficient alternating algorithm is developed to optimize the proposed model. Experimental results on eight benchmark datasets demonstrate the effectiveness of the proposed method.

Incremental Manifold Learning Regular Optimization Algorithm on Tangent Space and Feature Space Alignment

A Manifold Learning Algorithm Based on Incremental Tangent Space Alignment

Image Feature Optimization Based on Nonlinear Dimensionality Reduction

Learning Exemplar-Represented Manifolds in Latent Space for Classification.

Deep Manifold Transformation for Dimension Reduction

Incremental manifold learning via tangent space alignment

A New Manifold Learning Algorithm Based on Incremental Spectral Decomposition.

Deep Manifold Computing and Visualization

An Incremental Manifold Learning Algorithm Based on Iterative Decomposition

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

Incremental Alignment Manifold Learning

Incremental Manifold Learning by Spectral Embedding Methods

Incremental and evolutionary manifold learning: a survey

A feature space alignment learning algorithm

Multi-Sample Incremental Manifold Learning Algorithm Based on Isogonal Mapping

Tangent Space Learning and Generalization

A Novel Label Enhancement Algorithm Based on Manifold Learning

Learning Manifold Structures With Subspace Segmentations

Unsupervised Feature Selection Via Latent Representation Learning and Manifold Regularization

Incremental Multi-manifold Out-of-Sample Data Prediction

Nonlinear Dimension Reduction Via Local Tangent Space Alignment