Abstract:Tensor representation is helpful to reduce the small sample size problem in discriminative subspace selection. As pointed by this paper, this is mainly because the structure information of objects in computer vision research is a reasonable constraint to reduce the number of unknown parameters used to represent a learning model. Therefore, we apply this information to the vector-based learning and generalize the vector-based learning to the tensor-based learning as the supervised tensor learning (STL) framework, which accepts tensors as input. To obtain the solution of STL, the alternating projection optimization procedure is developed. The STL framework is a combination of the convex optimization and the operations in multilinear algebra. The tensor representation helps reduce the overfitting problem in vector-based learning. Based on STL and its alternating projection optimization procedure, we generalize support vector machines, minimax probability machine, Fisher discriminant analysis, and distance metric learning, to support tensor machines, tensor minimax probability machine, tensor Fisher discriminant analysis, and the multiple distance metrics learning, respectively. We also study the iterative procedure for feature extraction within STL. To examine the effectiveness of STL, we implement the tensor minimax probability machine for image classification. By comparing with minimax probability machine, the tensor version reduces the overfitting problem. D. Tao (B) · X. Li · S. J. Maybank School of Computer Science and Information Systems, Birkbeck, University of London, London, UK E-mail: dacheng.tao@gmail.com X. Wu Department of Computer Science, University of Vermont, Burlington, VT, USA W. Hu National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, P.R. China

A tensor factorization based least squares support tensor machine for classification

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Learning with Tensor Representation

A Multi-Class Large Margin Classifier

Dynamic least squares support vector machine

Fuzzy Least Squares Twin Support Vector Machines

Sparse non-negative transition subspace learning for image classification

Knowledge and Information Systems REGULAR PAPER

Image recognition and classification with HOG based on nonlinear support tensor machine

Biologically Inspired Tensor Features

A novel fuzzy twin support vector machine based on centered kernel alignment

Symmetric LINEX loss twin support vector machine for robust classification and its fast iterative algorithm

Triple Sparse Denoising Discriminantive Least Squares Regression for Image Classification

Deep Tensor Factorization for Hyperspectral Image Classification.

A Tensor SVD-based Classification Algorithm Applied to fMRI Data

Efficient Face Recognition Using Tensor Subspace Regression

The Flexible Tensor Singular Value Decomposition and Its Applications in Multisensor Signal Fusion Processing

An efficient Kernel-based matrixized least squares support vector machine

Low-Rank Multitask Learning based on Tensorized SVMs and LSSVMs

Multiple Rank Multi-Linear SVM for Matrix Data Classification.

Logistic tensor regression for classification