Abstract:Most supervised manifold learning-based methods preserve the original neighbor relationships to pursue the discriminating power. Thus, structure information of the data distributions might be neglected and destroyed in low-dimensional space in a certain sense. In this paper, a novel supervised method, called locality preserving embedding (LPE), is proposed to feature extraction and dimensionality reduction. LPE can give a low-dimensional embedding for discriminative multi-class sub-manifolds and preserves principal structure information of the local sub-manifolds. In LPE framework, supervised and unsupervised ideas are combined together to learn the optimal discriminant projections. On the one hand, the class information is taken into account to characterize the compactness of local sub-manifolds and the separability of different sub-manifolds. On the other hand, at the same time, all the samples in the local neighborhood are used to characterize the original data distributions and preserve the structure in low-dimensional subspace. The most significant difference from existing methods is that LPE takes the distribution directions of local neighbor data into account and preserves them in low-dimensional subspace instead of only preserving the each local sub-manifold’s original neighbor relationships. Therefore, LPE optimally preserves both the local sub-manifold’s original neighborhood relationships and the distribution direction of local neighbor data to separate different sub-manifolds as far as possible. The criterion, similar to the classical Fisher criterion, is a Rayleigh quotient in form, and the optimal linear projections are obtained by solving a generalized Eigen equation. Furthermore, the framework can be directly used in semi-supervised learning, and the semi-supervised LPE and semi-supervised kernel LPE are given. The proposed LPE is applied to face recognition (on the ORL and Yale face databases) and handwriting digital recognition (on the USPS database). The experimental results show that LPE consistently outperforms classical linear methods, e.g., principal component analysis and linear discriminant analysis, and the recent manifold learning-based methods, e.g., marginal Fisher analysis and constrained maximum variance mapping.

Classification with the hybrid of manifold learning and gabor wavelet

Learning Exemplar-Represented Manifolds in Latent Space for Classification.

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Geodesic Based Semi-supervised Multi-manifold Feature Extraction

Neighbourhood Sensitive Preserving Embedding for Pattern Classification.

Ensemble-Based discriminant manifold learning for face recognition

Locality preserving embedding for face and handwriting digital recognition

G-Optimal Feature Selection with Laplacian regularization

Geodesic Gabriel Graph Based Supervised Nonlinear Manifold Learning

Letters: Gabor face recognition by multi-channel classifier fusion of supervised kernel manifold learning

Unified locally linear embedding and linear discriminant analysis algorithm (ULLELDA) for face recognition

Gene Expression Data Classification Using Locally Linear Discriminant Embedding

Hierarchical Manifold Learning With Applications to Supervised Classification for High-Resolution Remotely Sensed Images

Grassmannian Discriminant Maps (GDM) for Manifold Dimensionality Reduction with Application to Image Set Classification

Unsupervised Image Classifier based on Manifold Learning

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Deep hybrid manifold for image set classification

Learning a Stable Local Manifold Representation for Hyperspectral Linear Dimensionality Reduction

Discriminant Analysis on Nonlinear Manifold Based on Geodesic Gabriel Graph

Integration of Manifold Learning and Density Estimation for Fine-Tuned Face Recognition