Abstract:Images are often represented as vectors with high dimensions when involved in classification. As a result, dimensionality reduction methods have to be developed to avoid the curse of dimensionality. Among them, Laplacian eigenmaps (LE) have attracted widespread concentrations. In the original LE, point to point (P2P) distance metric is often adopted for manifold learning. Unfortunately, they show few impacts on robustness to noises. In this paper, a novel supervised dimensionality reduction method, named feature space to feature space distance metric learning (FSDML), is presented. For any point, it can construct a feature space spanned by its k intra-class nearest neighbors, which results in a local projection on its nearest feature space. Thus feature space to feature space (S2S) distance metric will be defined to Euclidean distance between two corresponding projections. On one hand, the proposed S2S distance metric displays superiority on robustness by the local projection. On the other hand, the projection on the nearest feature space contributes to fully mining local geometry information hidden in the original data. Moreover, both class label similarity and dissimilarity are also measured, based on which an intra-class graph and an inter-class graph will be individually modeled. Finally, a subspace can be found for classification by maximizing S2S based manifold to manifold distance and preserving S2S based locality of manifolds, simultaneously. Compared to some state-of-art dimensionality reduction methods, experiments validate the proposed method's performance either on synthesized data sets or on benchmark data sets.

Distance metric learning by minimal distance maximization

Max-Min Distance Analysis by Using Sequential SDP Relaxation for Dimension Reduction

Dimension Reduction by Maximizing Pairwise Discriminations.

Distance Metric Learning with Penalized Linear Discriminant Analysis

Heteroscedastic Max-Min Distance Analysis.

Towards Robust Discriminative Projections Learning via Non-Greedy <i>l</i><sub>2,1</sub>-Norm MinMax

A New Formulation of Linear Discriminant Analysis for Robust Dimensionality Reduction

Self-centralized Jointly Sparse Maximum Margin Criterion for Robust Dimensionality Reduction.

Discriminative Dimension Reduction Via Maximin Separation Probability Analysis

Heteroscedastic Max–Min Distance Analysis for Dimensionality Reduction

Robust dimensionality reduction via feature space to feature space distance metric learning.

Laplacian MinMax Discriminant Projection and Its Applications.

Worst-Case Discriminative Feature Learning via Max-Min Ratio Analysis

Max-K-Min Distance Analysis for Dimension Reduction

Minimum-distance discriminant projection and its application to face recognition

Regularized Max-Min Linear Discriminant Analysis.

Max-min distance analysis by making a uniform distribution of class centers for dimensionality reduction

Towards Making High Dimensional Distance Metric Learning Practical

Dimension Reduction by Minimum Error Minimax Probability Machine

Fractional-step max-min distance analysis for dimension reduction

Laplacian MinMax Discriminant Analysis and Its Applications