Abstract:In the last few years, great efforts have been made to extend the linear projection technique (LPT) for multidimensional data (i.e., tensor), generally referred to as the multilinear projection technique (MPT). The vectorized nature of LPT requires high-dimensional data to be converted into vector, and hence may lose spatial neighborhood information of raw data. MPT well addresses this problem by encoding multidimensional data as general tensors of a second or even higher order. In this paper, we propose a novel multilinear projection technique, called multilinear spatial discriminant analysis (MSDA), to identify the underlying manifold of high-order tensor data. MSDA considers both the nonlocal structure and the local structure of data in the transform domain, seeking to learn the projection matrices from all directions of tensor data that simultaneously maximize the nonlocal structure and minimize the local structure. Different from multilinear principal component analysis (MPCA) that aims to preserve the global structure and tensor locality preserving projection (TLPP) that is in favor of preserving the local structure, MSDA seeks a tradeoff between the nonlocal (global) and local structures so as to drive its discriminant information from the range of the non-local structure and the range of the local structure. This spatial discriminant characteristic makes MSDA have more powerful manifold preserving ability than TLPP and MPCA. Theoretical analysis shows that traditional MPTs, such as multilinear linear discriminant analysis, TLPP, MPCA, and tensor maximum margin criterion, could be derived from the MSDA model by setting different graphs and constraints. Extensive experiments on face databases (ORL, CMU PIE, and the extended Yale-B) and the Weizmann action database demonstrate the effectiveness of the proposed MSDA method.

A Report on Multilinear PCA Plus Multilinear LDA to Deal with Tensorial Data: Visual Classification As an Example

On Multilinear Principal Component Analysis of Order-Two Tensors

A Survey of Two-dimensional PCA and 2DLDA

Multilinear Spatial Discriminant Analysis for Dimensionality Reduction

High-Order Multilinear Discriminant Analysis via Order-$\textit{n}$ Tensor Eigendecomposition

Multilinear Class-Specific Discriminant Analysis

Improved Discriminate Analysis for High-Dimensional Data and Its Application to Face Recognition.

Probabilistic Linear Discriminant Analysis with Vectorial Representation for Tensor Data.

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Block Linear Discriminant Analysis for Visual Tensor Objects with Frequency or Time Information

Multilinear Discriminant Analysis using a new family of tensor-tensor products

Directional Multimode Subspace Analysis with Tensor Representation-Discriminant Feature Extraction

Feature Extraction and Uncorrelated Discriminant Analysis for High-Dimensional Data

Extension of PCA to Higher Order Data Structures: An Introduction to Tensors, Tensor Decompositions, and Tensor PCA

Tensor object classification via multilinear discriminant analysis network

An MPCA/LDA Based Dimensionality Reduction Algorithm for Face Recognition

Cosine Multilinear Principal Component Analysis for Recognition

Generalized Visual Information Analysis Via Tensorial Algebra

Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

An Enhanced Linear Discriminant Analysis Criterion Based on Uniform Theory of PCA and LDA

Directional Independent Component Analysis With Tensor Representation