Abstract:We study the problem of projecting high-dimensional tensor data on an unspecified Riemannian manifold onto some lower dimensional subspace1 without much distorting the pairwise geodesic distances between data points on the Riemannian manifold while preserving discrimination ability. Existing algorithms, e.g., ISOMAP, that try to learn an isometric embedding of data points on a manifold have a non-satisfactory discrimination ability in practical applications such as face and gait recognition. In this paper, we propose a two-stage algorithm named tensor-based Riemannian manifold distance-approximating projection (TRIMAP), which can quickly compute an approximately optimal projection for a given tensor data set. In the first stage, we construct a graph from labeled or unlabeled data, which correspond to the supervised and unsupervised scenario, respectively, such that we can use the graph distance to obtain an upper bound on an objective function that preserves pairwise geodesic distances. Then, we perform some tensor-based optimization of this upper bound to obtain a projection onto a low-dimensional subspace. In the second stage, we propose three different strategies to enhance the discrimination ability, i.e., make data points from different classes easier to separate and make data points in the same class more compact. Experimental results on two benchmark data sets from the University of South Florida human gait database and the Face Recognition Technology face database show that the discrimination ability of TRIMAP exceeds that of other popular algorithms. We theoretically show that TRIMAP converges. We demonstrate, through experiments on six synthetic data sets, its potential ability to unfold nonlinear manifolds in the first stage. Index Terms-Gait recognition, linear discriminant analysis, manifold learning, multilinear tensor learning.

Trace Ratio Based Manifold Learning With Tensor Data

Trace Ratio Based Manifold Learning with Tensor Data

Deep Manifold Transformation for Dimension Reduction

Deep Manifold Transformation for Nonlinear Dimensionality Reduction

Multilinear Discriminant Analysis using a new family of tensor-tensor products

Distance Approximating Dimension Reduction of Riemannian Manifolds

Multilinear Low-Rank Tensors on Graphs & Applications

Tensor Rank One Discriminant Analysis—A convergent method for discriminative multilinear subspace selection

Trace Ratio Optimization with an Application to Multi-view Learning

Riemannian manifold learning.

Feature Extraction by Learning Lorentzian Metric Tensor and Its Extensions.

T-Sne for Complex Multi-Manifold High-Dimensional Data

Statistical analysis of tensor fields

Trace Ratio Problem Revisited

Deep Multi-Task Learning via Generalized Tensor Trace Norm

Low-tubal-rank tensor factorization on constant curvature Riemann manifold with mixture of Gaussians

A geometric viewpoint of manifold learning

Multi-Tensor Network Representation for High-Order Tensor Completion

Sparse Alignment for Robust Tensor Learning.

Statistics on the Manifold of Multivariate Normal Distributions: Theory and Application to Diffusion Tensor MRI Processing

Tensor Completion with Side Information: A Riemannian Manifold Approach