Abstract:In this paper, we address two challenging problems in unsupervised subspace learning: 1) how to automatically identify the feature dimension of the learned subspace (i.e., automatic subspace learning), and 2) how to learn the underlying subspace in the presence of Gaussian noise (i.e., robust subspace learning). We show that these two problems can be simultaneously solved by proposing a new method (called principal coefficients embedding, PCE). For a given data set $\mathbf{D}\in \mathds{R}^{m\times n}$, PCE recovers a clean data set $\mathbf{D}_{0}\in \mathds{R}^{m\times n}$ from $\mathbf{D}$ and simultaneously learns a global reconstruction relation $\mathbf{C}\in \mathbf{R}^{n\times n}$ of $\mathbf{D}_{0}$. By preserving $\mathbf{C}$ into an $m^{\prime}$-dimensional space, the proposed method obtains a projection matrix that can capture the latent manifold structure of $\mathbf{D}_{0}$, where $m^{\prime}\ll m$ is automatically determined by the rank of $\mathbf{C}$ with theoretical guarantees. PCE has three advantages: 1) it can automatically determine the feature dimension even though data are sampled from a union of multiple linear subspaces in presence of the Gaussian noise, 2) Although the objective function of PCE only considers the Gaussian noise, experimental results show that it is robust to the non-Gaussian noise (\textit{e.g.}, random pixel corruption) and real disguises, 3) Our method has a closed-form solution and can be calculated very fast. Extensive experimental results show the superiority of PCE on a range of databases with respect to the classification accuracy, robustness and efficiency.

Progressive Subspace Ensemble Learning

Subspace Ensembles for Classification

A Progressive Stacking Pseudoinverse Learning Framework via Active Learning in Random Subspaces

Multi-class AdaBoost ELM

Active Clustering Ensemble With Self-Paced Learning

Adaptive Subspace Optimization Ensemble Method for High-Dimensional Imbalanced Data Classification

Multi-label Subspace Ensemble.

Subspace Embedding for Classification

Subspace learning machine (SLM): Methodology and performance evaluation

Random Subspace Ensembles for Hyperspectral Image Classification With Extended Morphological Attribute Profiles

Progressive Stage-wise Learning for Unsupervised Feature Representation Enhancement

Ensemble Classifier Design Based on Perturbation Binary Salp Swarm Algorithm for Classification

A Progressive Feature Selection Algorithm for Ultra Large Feature Spaces.

Feature-subspace Aggregating: Ensembles for Stable and Unstable Learners

Automatic Subspace Learning via Principal Coefficients Embedding

Learning Classifier System Ensemble for Data Mining

Ensemble selection with joint spectral clustering and structural sparsity

Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learning

PSS: Progressive Sample Selection for Open-World Visual Representation Learning

Self-Paced Clustering Ensemble

Experimental Study and Comparison of Imbalance Ensemble Classifiers with Dynamic Selection Strategy