Abstract:We study the problem of projecting high-dimensional tensor data on an unspecified Riemannian manifold onto some lower dimensional subspace1 without much distorting the pairwise geodesic distances between data points on the Riemannian manifold while preserving discrimination ability. Existing algorithms, e.g., ISOMAP, that try to learn an isometric embedding of data points on a manifold have a non-satisfactory discrimination ability in practical applications such as face and gait recognition. In this paper, we propose a two-stage algorithm named tensor-based Riemannian manifold distance-approximating projection (TRIMAP), which can quickly compute an approximately optimal projection for a given tensor data set. In the first stage, we construct a graph from labeled or unlabeled data, which correspond to the supervised and unsupervised scenario, respectively, such that we can use the graph distance to obtain an upper bound on an objective function that preserves pairwise geodesic distances. Then, we perform some tensor-based optimization of this upper bound to obtain a projection onto a low-dimensional subspace. In the second stage, we propose three different strategies to enhance the discrimination ability, i.e., make data points from different classes easier to separate and make data points in the same class more compact. Experimental results on two benchmark data sets from the University of South Florida human gait database and the Face Recognition Technology face database show that the discrimination ability of TRIMAP exceeds that of other popular algorithms. We theoretically show that TRIMAP converges. We demonstrate, through experiments on six synthetic data sets, its potential ability to unfold nonlinear manifolds in the first stage. Index Terms-Gait recognition, linear discriminant analysis, manifold learning, multilinear tensor learning.

Semi-Supervised Dimension Reduction Using Trace Ratio Criterion.

Recursive Dimension Reduction for Semisupervised Learning

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

Trace Ratio Problem Revisited

Ratio sum formula for dimensionality reduction

Flexible orthogonal semisupervised learning for dimension reduction with image classification

A Novel Formulation of Trace Ratio Linear Discriminant Analysis

The Necessary and Sufficient Conditions for the Existence of the Optimal Solution of Trace Ratio Problems

A Revised Formation of Trace Ratio LDA for Small Sample Size Problem.

Semi-supervised Orthogonal Discriminant Analysis Via Label Propagation

Stable and orthogonal local discriminant embedding using trace ratio criterion for dimensionality reduction

Trace Ratio Optimization with an Application to Multi-view Learning

Supervised Dimensionality Reduction Via Sequential Semidefinite Programming

A variant of the trace quotient formulation for dimensionality reduction

Efficient Semi-Supervised Feature Selection with Noise Insensitive Trace Ratio Criterion

Beyond Trace Ratio: Weighted Harmonic Mean of Trace Ratios for Multiclass Discriminant Analysis

A Convergence Analysis on the Iterative Trace Ratio Algorithm and Its Refinements

Adaptive Semi-Supervised Dimensionality Reduction

Relative Manifold Based Semi-Supervised Dimensionality Reduction

Semisupervised Tangent Space Discriminant Analysis

Distance Approximating Dimension Reduction of Riemannian Manifolds