Abstract:In the last few years, great efforts have been made to extend the linear projection technique (LPT) for multidimensional data (i.e., tensor), generally referred to as the multilinear projection technique (MPT). The vectorized nature of LPT requires high-dimensional data to be converted into vector, and hence may lose spatial neighborhood information of raw data. MPT well addresses this problem by encoding multidimensional data as general tensors of a second or even higher order. In this paper, we propose a novel multilinear projection technique, called multilinear spatial discriminant analysis (MSDA), to identify the underlying manifold of high-order tensor data. MSDA considers both the nonlocal structure and the local structure of data in the transform domain, seeking to learn the projection matrices from all directions of tensor data that simultaneously maximize the nonlocal structure and minimize the local structure. Different from multilinear principal component analysis (MPCA) that aims to preserve the global structure and tensor locality preserving projection (TLPP) that is in favor of preserving the local structure, MSDA seeks a tradeoff between the nonlocal (global) and local structures so as to drive its discriminant information from the range of the non-local structure and the range of the local structure. This spatial discriminant characteristic makes MSDA have more powerful manifold preserving ability than TLPP and MPCA. Theoretical analysis shows that traditional MPTs, such as multilinear linear discriminant analysis, TLPP, MPCA, and tensor maximum margin criterion, could be derived from the MSDA model by setting different graphs and constraints. Extensive experiments on face databases (ORL, CMU PIE, and the extended Yale-B) and the Weizmann action database demonstrate the effectiveness of the proposed MSDA method.

Correlation-based multidimensional scaling for unsupervised subspace learning

Multi-View Correlated Feature Learning by Uncovering Shared Component.

Multi-view Dimensionality Reduction Learning with Hierarchical Sparse Feature Selection

Multi-Dimensional Classification Via Class Space Fusion and Comprehensive Label Correlations

Classical Multidimensional Scaling: A Subspace Perspective, Over-Denoising, and Outlier Detection

Unsupervised Subspace Learning Via Analysis Dictionary Learning.

Multidimensional Scaling on Multiple Input Distance Matrices

Universum Discriminant Canonical Correlation Analysis

Unsupervised Multi-view Subspace Learning via Maximizing Dependence.

Discriminant Learning Through Multiple Principal Angles for Visual Recognition

Constraint Based Dimension Correlation and Distance Divergence for Clustering High-Dimensional Data

Sparse Regularized Discriminative Canonical Correlation Analysis for Multi-View Semi-Supervised Learning

Research on Multi-Dimension Scaling Algorithm

Multi-view Subspace Clustering with View Correlations Via Low-Rank Tensor Learning

Unsupervised 2D dimensionality reduction by jointly learning structural and temporal correlation

Learning shared subspace for multi-label dimensionality reduction via dependence maximization

Multilinear Spatial Discriminant Analysis for Dimensionality Reduction

Multiview Dimension Reduction Via Hessian Multiset Canonical Correlations.

Multi-dimensional Scaling from K-Nearest Neighbourhood Distances

Discriminative Sparse Generalized Canonical Correlation Analysis (DSGCCA)

Multi-Scale Deep Subspace Clustering With Discriminative Learning