Abstract:We present a new manifold learning algorithm called Local Orthogonality Preserving Alignment (LOPA). Our algorithm is inspired by the Local Tangent Space Alignment (LTSA) method that aims to align multiple local neighborhoods into a global coordinate system using affine transformations. However, LTSA often fails to preserve original geometric quantities such as distances and angles. Although an iterative alignment procedure for preserving orthogonality was suggested by the authors of LTSA, neither the corresponding initialization nor the experiments were given. Procrustes Subspaces Alignment (PSA) implements the orthogonality preserving idea by estimating each rotation transformation separately with simulated annealing. However, the optimization in PSA is complicated and multiple separated local rotations may produce globally contradictive results. To address these difficulties, we first use the pseudo-inverse trick of LTSA to represent each local orthogonal transformation with the unified global coordinates. Second the orthogonality constraints are relaxed to be an instance of semi-definite programming (SDP). Finally a two-step iterative procedure is employed to further reduce the errors in orthogonal constraints. Extensive experiments show that LOPA can faithfully preserve distances, angles, inner products, and neighborhoods of the original datasets. In comparison, the embedding performance of LOPA is better than that of PSA and comparable to that of state-of-the-art algorithms like MVU and MVE, while the runtime of LOPA is significantly faster than that of PSA, MVU and MVE.

Local Tangent Space Alignment Algorithm of Generalized Improvement

Learning a Locality Preserving Subspace for Visual Recognition.

Supervised Local Tangent Space Alignment for Classification

Independent Component Analysis: Embedded LTSA

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Discriminative analysis algorithm for linear local tangent spaces

Incremental manifold learning via tangent space alignment

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

A local tangent space alignment based transductive classification algorithm

Nonlinear Dimension Reduction Via Local Tangent Space Alignment

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Robust Face Alignment Based on Local Texture Classifiers

Comparisons of Local Methods for Face Alignment.

Local Orthogonality Preserving Alignment for Nonlinear Dimensionality Reduction

Tangent Space Learning and Generalization

Local Coordinates Alignment (Lca): A Novel Manifold Learning Approach

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Nonlinear Dimensionality Reduction by Local Orthogonality Preserving Alignment

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Dimension Reduction of Microarray Data Based on Local Tangent Space Alignment