Abstract:Dimensionality reduction is a hot research topic in pattern recognition. Traditional dimensionality reduction methods can be separated into linear dimensionality reduction methods and nonlinear dimensionality reduction methods. Linear dimensionality reduction methods usually utilize Euclidean distances to explore global geometric structures, and nonlinear dimensionality reduction methods can preserve local manifold structures in learned low-dimensional subspaces. However, redundant information and noises of the raw high-dimensional data restrict the classification performance of these methods. To solve the problem, we propose a novel orthogonal dimensionality reduction method based on twin eigen decomposition called orthogonal locality and globality preserving projections (OLGPP). Orthogonality, as a commonly used criterion in pattern recognition, is insensitive to the redundant information and the noises. OLGPP not only combines the advantages of global Euclidean structures and local manifold structures, but also is insensitive to the redundant information and noises of the raw high-dimensional data by embedding the orthogonality criterion. Additionally, the objective function based on twin eigen decomposition can be solved sequentially to obtain analytical solutions. On four well-known datasets, we design extensive experiments to evaluate the performance of OLGPP. From the experimental results, OLGPP has the optimal experimental results, and its average recognition rates are about 10% higher than the classic local dimensionality reduction method (i.e., locality preserving projection), which proves OLGPP is an effective dimensionality reduction method.

Orthogonal Isometric Projection

Learning Orthogonal Projections for Isomap

Orthogonal Locality Preserving Indexing

Orthogonal projection analysis

Discriminant Isomap projection

Orthogonal Self-Guided Similarity Preserving Projections

Isometric Projection with Reconstruction

Approximate Orthogonal Sparse Embedding for Dimensionality Reduction

A-Optimal Projection for Image Representation.

Orthogonal Projective Sparse Coding for Image Representation

Semi-supervised Orthogonal Graph Embedding with Recursive Projections.

Learnable Subspace Orthogonal Projection for Semi-supervised Image Classification

Linearization of Isomap

Multi-Instance Dimensionality Reduction via Sparsity and Orthogonality

Fast Orthogonal Projection Based on Kronecker Product

Robust Bi-Orthogonal Projection Learning: An Enhanced Dimensionality Reduction Method and Its Application in Unsupervised Learning †

Orthogonal manifold preserving projections

Local Feature Discriminant Projection

An Orthogonal Locality and Globality Dimensionality Reduction Method Based on Twin Eigen Decomposition

An Online Incremental Orthogonal Component Analysis Method for Dimensionality Reduction

Fast and Orthogonal Locality Preserving Projections for Dimensionality Reduction.