Abstract:Tensor representation is helpful to reduce the small sample size problem in discriminative subspace selection. As pointed by this paper, this is mainly because the structure information of objects in computer vision research is a reasonable constraint to reduce the number of unknown parameters used to represent a learning model. Therefore, we apply this information to the vector-based learning and generalize the vector-based learning to the tensor-based learning as the supervised tensor learning (STL) framework, which accepts tensors as input. To obtain the solution of STL, the alternating projection optimization procedure is developed. The STL framework is a combination of the convex optimization and the operations in multilinear algebra. The tensor representation helps reduce the overfitting problem in vector-based learning. Based on STL and its alternating projection optimization procedure, we generalize support vector machines, minimax probability machine, Fisher discriminant analysis, and distance metric learning, to support tensor machines, tensor minimax probability machine, tensor Fisher discriminant analysis, and the multiple distance metrics learning, respectively. We also study the iterative procedure for feature extraction within STL. To examine the effectiveness of STL, we implement the tensor minimax probability machine for image classification. By comparing with minimax probability machine, the tensor version reduces the overfitting problem. D. Tao (B) · X. Li · S. J. Maybank School of Computer Science and Information Systems, Birkbeck, University of London, London, UK E-mail: dacheng.tao@gmail.com X. Wu Department of Computer Science, University of Vermont, Burlington, VT, USA W. Hu National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, P.R. China

Subspace Learning Based on Tensor Analysis

Image retrieval based on incremental subspace learning

Tensor Subspace Analysis.

Learning a Locality Preserving Subspace for Visual Recognition.

Locality Pursuit Embedding

Learning a Spatially Smooth Subspace for Face Recognition

Subspace learning via Locally Constrained A-optimal nonnegative projection.

Local Feature Discriminant Projection

Chapter 3 Face Subspace Learning

Optimum Subspace Learning And Error Correction For Tensors

Active subspace learning

Learning with Tensor Representation

Tensor low-rank sparse representation for tensor subspace learning

Sparse tensor discriminant analysis

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Spectral Regression: A Unified Approach for Sparse Subspace Learning

Knowledge and Information Systems REGULAR PAPER

Robust Discriminative t-Linear Subspace Learning for Image Feature Extraction

Subspace Structural Constraint-Based Discriminative Feature Learning Via Nonnegative Low Rank Representation

Learning a Subspace for Clustering Via Pattern Shrinking

Transductive Component Analysis