Abstract:Subspace learning aims to learn a projection matrix from a given training set so that a transformation of raw data to a low-dimensional representation can be obtained. In practice, the labels of some training samples are available, which can be used to improve the discrimination of low-dimensional representation. In this paper, we propose a semi-supervised learning method which is inspired by the biological observation of similar inputs having similar codes (SISC), i.e., the same collection of cortical columns of the mammal's visual cortex is always activated by the similar stimuli. More specifically, we propose a mathematical formulation of SISC which minimizes the distance among the data points with the same label while maximizing the separability between different subjects in the projection space. The proposed method, namely, semi-supervised L2graph (SeL2graph) has two advantages: (1) unlike the classical dimension reduction methods such as principle component analysis, SeL2graph can automatically determine the dimension of feature space. This remarkably reduces the effort to find an optimal feature dimension for a good performance; and (2) it fully exploits the prior knowledge carried by the labeled samples and thus the obtained features are with higher discrimination and compactness. Extensive experiments show that the proposed method outperforms 7 subspace learning algorithms on 15 data sets with respect to classification accuracy, computational efficiency, and robustness to noises and disguises. HighlightsA semi-supervised subspace learning method is proposed.The method is inspired by similar inputs having similar code.The method can automatically determine the feature dimension.

Linear Subspace Learning via sparse dimension reduction

Learning a Locality Preserving Subspace for Visual Recognition.

A linear subspace learning approach via sparse coding

Subspace learning via Locally Constrained A-optimal nonnegative projection.

Local Feature Discriminant Projection

Sparse Local Discriminant Projections for Feature Extraction

A Linear Subspace Learning Algorithm For Incremental Data

Subspace Learning Based on Tensor Analysis

Linear Discriminative Sparsity Preserving Projections for Dimensionality Reduction

A Linear Subspace Learning Approach via Low Rank Decomposition

Dynamic Principal Subspaces with Sparsity in High Dimensions

Spectral Regression: A Unified Approach for Sparse Subspace Learning

Learning Feature Sparse Principal Subspace.

Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons

Semi-supervised subspace learning with L2graph.

Low-Rank Sparse Preserving Projections for Dimensionality Reduction

Joint Sparse Local Linear Discriminant Analysis for Feature Dimensionality Reduction of Hyperspectral Images

A Pareto-Based Sparse Subspace Learning Framework.

Sparsity Induced Locality Preserving Projection Approaches for Dimensionality Reduction

Dynamic Principal Subspaces in High Dimensions

Sparse L1-norm-based linear discriminant analysis