Abstract:Tensor (multidimensional array) classification problem has become very popular in modern applications such as image recognition and high dimensional spatio-temporal data analysis. Support Tensor Machine (STM) classifier, which is extended from the support vector machine, takes CANDECOMP / Parafac (CP) form of tensor data as input and predicts the data labels. The distribution-free and statistically consistent properties of STM highlight its potential in successfully handling wide varieties of data applications. Training a STM can be computationally expensive with high-dimensional tensors. However, reducing the size of tensor with a random projection technique can reduce the computational time and cost, making it feasible to handle large size tensors on regular machines. We name an STM estimated with randomly projected tensor as Random Projection-based Support Tensor Machine (RPSTM). In this work, we propose a Tensor Ensemble Classifier (TEC), which aggregates multiple RPSTMs for big tensor classification. TEC utilizes the ensemble idea to minimize the excessive classification risk brought by random projection, providing statistically consistent predictions while taking the computational advantage of RPSTM. Since each RPSTM can be estimated independently, TEC can further take advantage of parallel computing techniques and be more computationally efficient. The theoretical and numerical results demonstrate the decent performance of TEC model in high-dimensional tensor classification problems. The model prediction is statistically consistent as its risk is shown to converge to the optimal Bayes risk. Besides, we highlight the trade-off between the computational cost and the prediction risk for TEC model. The method is validated by extensive simulation and a real data example. We prepare a python package for applying TEC, which is available at our GitHub.

A Support Third-Order Tensor Machine Model for Tensor Recognition

TensorFormer: A Tensor-Based Multimodal Transformer for Multimodal Sentiment Analysis and Depression Detection

Knowledge and Information Systems REGULAR PAPER

Domain Adaptation Support Tensor Machine: An Extended STM for Object Recognition Using Cross-Source Heterogeneous Remote Sensing Data

Learning with Tensor Representation

Topic Tensor Factorization for Recommender System

Image recognition and classification with HOG based on nonlinear support tensor machine

A Multifeature Tensor for Remote-Sensing Target Recognition

TEC: Tensor Ensemble Classifier for Big Data

Computational and Statistical Guarantees for Tensor-on-Tensor Regression with Tensor Train Decomposition

Biologically Inspired Tensor Features

Sparse and Low-rank Tucker Decomposition with Its Application to 2D+3D Facial Expression Recognition

5-D Spatial-Temporal Information-Based Infrared Small Target Detection in Complex Environments

Stable third-order tensor representation for colour image classification

An Iterative Reweighted Method for Tucker Decomposition of Incomplete Multiway Tensors

Multiscale Feature Tensor Train Rank Minimization for Multidimensional Image Recovery

a-Tucker: Input-Adaptive and Matricization-Free Tucker Decomposition for Dense Tensors on CPUs and GPUs

A novel associative memory model based on semi-tensor product (STP)

Infrared Dim and Small Target Detection Based on Superpixel Segmentation and Spatiotemporal Cluster 4D Fully-Connected Tensor Network Decomposition

Tensor Decomposition for Signal Processing and Machine Learning

Infrared Small Target Detection via Nonconvex Tensor Tucker Decomposition With Factor Prior