Abstract:In this paper, we address two challenging problems in unsupervised subspace learning: 1) how to automatically identify the feature dimension of the learned subspace (i.e., automatic subspace learning), and 2) how to learn the underlying subspace in the presence of Gaussian noise (i.e., robust subspace learning). We show that these two problems can be simultaneously solved by proposing a new method (called principal coefficients embedding, PCE). For a given data set $\mathbf{D}\in \mathds{R}^{m\times n}$, PCE recovers a clean data set $\mathbf{D}_{0}\in \mathds{R}^{m\times n}$ from $\mathbf{D}$ and simultaneously learns a global reconstruction relation $\mathbf{C}\in \mathbf{R}^{n\times n}$ of $\mathbf{D}_{0}$. By preserving $\mathbf{C}$ into an $m^{\prime}$-dimensional space, the proposed method obtains a projection matrix that can capture the latent manifold structure of $\mathbf{D}_{0}$, where $m^{\prime}\ll m$ is automatically determined by the rank of $\mathbf{C}$ with theoretical guarantees. PCE has three advantages: 1) it can automatically determine the feature dimension even though data are sampled from a union of multiple linear subspaces in presence of the Gaussian noise, 2) Although the objective function of PCE only considers the Gaussian noise, experimental results show that it is robust to the non-Gaussian noise (\textit{e.g.}, random pixel corruption) and real disguises, 3) Our method has a closed-form solution and can be calculated very fast. Extensive experimental results show the superiority of PCE on a range of databases with respect to the classification accuracy, robustness and efficiency.

Orthogonal Principal Coefficients Embedding for Unsupervised Subspace Learning

Image retrieval based on incremental subspace learning

Automatic Subspace Learning via Principal Coefficients Embedding

Incremental semi-supervised subspace learning for image retrieval.

Learning a Locality Preserving Subspace for Visual Recognition.

Learnable Subspace Orthogonal Projection for Semi-supervised Image Classification

Self-representation and PCA Embedding for Unsupervised Feature Selection

Unsupervised robust discriminative subspace representation based on discriminative approximate isometric embedding

A General Approach for Achieving Supervised Subspace Learning in Sparse Representation

Orthogonal Projective Sparse Coding for Image Representation

Learning Feature Sparse Principal Subspace.

Robust Bi-Orthogonal Projection Learning: An Enhanced Dimensionality Reduction Method and Its Application in Unsupervised Learning †

Learning an Orthogonal and Smooth Subspace for Image Classification.

Robust Principal Component Analysis Via Joint Reconstruction and Projection.

Approximate Orthogonal Sparse Embedding for Dimensionality Reduction

A Semi-supervised Orthogonal Subspace Learning with Spline Embedding

Subspace learning via Locally Constrained A-optimal nonnegative projection.

Dynamic Principal Subspaces in High Dimensions

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Learning Strictly Orthogonal P-Order Nonnegative Laplacian Embedding Via Smoothed Iterative Reweighted Method.

Dynamic Principal Subspaces with Sparsity in High Dimensions