Abstract:We study the problem of projecting high-dimensional tensor data on an unspecified Riemannian manifold onto some lower dimensional subspace1 without much distorting the pairwise geodesic distances between data points on the Riemannian manifold while preserving discrimination ability. Existing algorithms, e.g., ISOMAP, that try to learn an isometric embedding of data points on a manifold have a non-satisfactory discrimination ability in practical applications such as face and gait recognition. In this paper, we propose a two-stage algorithm named tensor-based Riemannian manifold distance-approximating projection (TRIMAP), which can quickly compute an approximately optimal projection for a given tensor data set. In the first stage, we construct a graph from labeled or unlabeled data, which correspond to the supervised and unsupervised scenario, respectively, such that we can use the graph distance to obtain an upper bound on an objective function that preserves pairwise geodesic distances. Then, we perform some tensor-based optimization of this upper bound to obtain a projection onto a low-dimensional subspace. In the second stage, we propose three different strategies to enhance the discrimination ability, i.e., make data points from different classes easier to separate and make data points in the same class more compact. Experimental results on two benchmark data sets from the University of South Florida human gait database and the Face Recognition Technology face database show that the discrimination ability of TRIMAP exceeds that of other popular algorithms. We theoretically show that TRIMAP converges. We demonstrate, through experiments on six synthetic data sets, its potential ability to unfold nonlinear manifolds in the first stage. Index Terms-Gait recognition, linear discriminant analysis, manifold learning, multilinear tensor learning.

Trace Ratio Problem Revisited

A Convergence Analysis on the Iterative Trace Ratio Algorithm and Its Refinements

A Note on the Trace Quotient Problem.

A subspace method for large-scale trace ratio problems

Trace Ratio Optimization with an Application to Multi-view Learning

Perturbation Analysis for the Trace Quotient Problem

A Novel Formulation of Trace Ratio Linear Discriminant Analysis

A variant of the trace quotient formulation for dimensionality reduction

A Convex Programming Approach To The Trace Quotient Problem

Comments and CorrectionsConvergence Analysis on Trace Ratio Linear Discriminant Analysis Algorithms.

Beyond Trace Ratio: Weighted Harmonic Mean of Trace Ratios for Multiclass Discriminant Analysis

Trace Ratio Criterion for Feature Extraction in Classification

Trace reconstruction of matrices and hypermatrices

Closing the duality gap of the generalized trace ratio problem

Trace Ratio Based Manifold Learning With Tensor Data

Distance Approximating Dimension Reduction of Riemannian Manifolds

Recursive Dimension Reduction for Semisupervised Learning

Trace-Penalty Minimization for Large-Scale Eigenspace Computation

Coordinate Descent Optimized Trace Difference Model for Joint Clustering and Feature Extraction

Nonparametric Trace Regression in High Dimensions via Sign Series Representation