Abstract:In this paper, we address two challenging problems in unsupervised subspace learning: 1) how to automatically identify the feature dimension of the learned subspace (i.e., automatic subspace learning), and 2) how to learn the underlying subspace in the presence of Gaussian noise (i.e., robust subspace learning). We show that these two problems can be simultaneously solved by proposing a new method (called principal coefficients embedding, PCE). For a given data set $\mathbf{D}\in \mathds{R}^{m\times n}$, PCE recovers a clean data set $\mathbf{D}_{0}\in \mathds{R}^{m\times n}$ from $\mathbf{D}$ and simultaneously learns a global reconstruction relation $\mathbf{C}\in \mathbf{R}^{n\times n}$ of $\mathbf{D}_{0}$. By preserving $\mathbf{C}$ into an $m^{\prime}$-dimensional space, the proposed method obtains a projection matrix that can capture the latent manifold structure of $\mathbf{D}_{0}$, where $m^{\prime}\ll m$ is automatically determined by the rank of $\mathbf{C}$ with theoretical guarantees. PCE has three advantages: 1) it can automatically determine the feature dimension even though data are sampled from a union of multiple linear subspaces in presence of the Gaussian noise, 2) Although the objective function of PCE only considers the Gaussian noise, experimental results show that it is robust to the non-Gaussian noise (\textit{e.g.}, random pixel corruption) and real disguises, 3) Our method has a closed-form solution and can be calculated very fast. Extensive experimental results show the superiority of PCE on a range of databases with respect to the classification accuracy, robustness and efficiency.

Subspace Principal Angle Preserving Property Of Gaussian Random Projection

PRINCIPAL ANGLES PRESERVING PROPERTY OF GAUSSIAN RANDOM PROJECTION FOR SUBSPACES

Properties of Bernoulli Random Projection for Embedding Subspaces

Random projections of random manifolds

Compressed Subspace Learning Based on Canonical Angle Preserving Property

Image Reconstruction Based on Sub-Gaussian Random Projection

Dynamic Principal Subspaces in High Dimensions

Orthogonal projection analysis

Which exceptional low-dimensional projections of a Gaussian point cloud can be found in polynomial time?

Restricted Isometry Property of Gaussian Random Projection for Finite Set of Subspaces.

Rigorous Restricted Isometry Property of Low-Dimensional Subspaces.

Unraveling the Veil of Subspace RIP Through Near-Isometry on Subspaces

Mixture Probabilistic Principal Geodesic Analysis

The Algebra And Statistics Of Generalized Principal Component Analysis

Random Angular Projection for Fast Nearest Subspace Search

Random projections beyond zero overlap

Dynamic Principal Subspaces with Sparsity in High Dimensions

Automatic Subspace Learning via Principal Coefficients Embedding

Spherical random projection

Random Projections for Classification: A Recovery Approach

Subspace Searching Based Generalized Principal Component Analysis