Abstract:To defy the curse of dimensionality, the inputs are always projected from the original high-dimensional space into the target low-dimension space for feature extraction. However, due to the existence of noise and outliers, the feature extraction task for corrupted data is still a challenging problem. Recently, a robust method called low rank embedding (LRE) was proposed. Despite the success of LRE in experimental studies, it also has many disadvantages: 1) The learned projection cannot quantitatively interpret the importance of features. 2) LRE does not perform data reconstruction so that the features may not be capable of holding the main energy of the original "clean" data. 3) LRE explicitly transforms error into the target space. 4) LRE is an unsupervised method, which is only suitable for unsupervised scenarios. To address these problems, in this paper, we propose a novel method to exploit the latent discriminative features. In particular, we first utilize an orthogonal matrix to hold the main energy of the original data. Next, we introduce an l(2,1)-norm term to encourage the features to be more compact, discriminative and interpretable. Then, we enforce a columnwise l(2,1)-norm constraint on an error component to resist noise. Finally, we integrate a classification loss term into the objective function to fit supervised scenarios. Our method performs better than several state-of-the-art methods in terms of effectiveness and robustness, as demonstrated on six publicly available datasets.

Robust locally nonlinear embedding (RLNE) for dimensionality reduction of high-dimensional data with noise

Image Feature Optimization Based on Nonlinear Dimensionality Reduction

Locality Pursuit Embedding

Robust Hessian Locally Linear Embedding Techniques for High-Dimensional Data

Local Neighborhood Embedding for Unsupervised Nonlinear Dimension Reduction.

Local Linear Embedding in Dimensionality Reduction Based on Small World Principle

Nonlinear embedding preserving multiple local-linearities

Robust Neighborhood Embedding for Unsupervised Feature Selection.

Local Linear Embedding with Adaptive Neighbors.

Learning Latent Low-Rank and Sparse Embedding for Robust Image Feature Extraction

Small World Neighborhood Optimized Local Linear Embedding Algorithm

Self-organized locally linear embedding for nonlinear dimensionality reduction

Noisy Manifold Learning Using Neighborhood Smoothing Embedding

Clustering-Based Locally Linear Embedding

Local Neighbor Propagation Embedding.

Robust Locally Linear Embedding Algorithm for Machinery Fault Diagnosis.

Relative Distance-Based Laplacian Eigenmaps

Robust non-negative supervised low-rank discriminant embedding (NSLRDE) for feature extraction

Robust Linear Embeding Based on a Kernel Function

Dynamic Neighborhood Selection for Nonlinear Dimensionality Reduction

Riemannian manifold learning for nonlinear dimensionality reduction