Abstract:Many classical data processing techniques rely on the representation and computation of vector and matrix forms, where the vectorization or matricization is often employed on multidimensional data. However, during this process, vital underlying structure information can be lost, leading to suboptimal performances in processing. As a natural representation for multidimensional data, the tensor has drawn a great deal of attention over the past several years. Tensor decompositions are effective tools for tensor analysis. They have been intensively investigated in a number of areas, such as signal processing, machine learning, neuroscience, communication, psychometrics, chemometrics, biometrics, quantum physics, and quantum chemistry. In this chapter, we give a brief introduction into the basic operations of tensors and illustrate them with a few examples in data processing. To better manipulate tensor data, a number of tensor operators are defined, especially different tensor products. In addition, we elaborate on a series of important tensor decompositions and their properties, including CANDECOMP/PARAFAC decomposition, Tucker decomposition, tensor singular value decomposition, block term decomposition, tensor tree decomposition, tensor train decomposition, and tensor ring decomposition. We further present a list of machine learning techniques based on tensor decompositions, such as tensor dictionary learning, tensor completion, robust tensor principal component analysis, tensor regression, statistical tensor classification, coupled tensor fusion, and deep tensor neural networks. Finally, we discuss the challenges and opportunities for data processing under a tensor scheme.

Kernelization of Tensor-Based Models for Multiway Data Analysis: Processing of Multidimensional Structured Data.

A Report on Multilinear PCA Plus Multilinear LDA to Deal with Tensorial Data: Visual Classification As an Example

Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis

Era of Big Data Processing: A New Approach via Tensor Networks and Tensor Decompositions

Tensor Methods in High Dimensional Data Analysis: Opportunities and Challenges

Scalable Nonparametric Multiway Data Analysis.

Bayesian Nonparametric Models for Multiway Data Analysis

Extension of PCA to Higher Order Data Structures: An Introduction to Tensors, Tensor Decompositions, and Tensor PCA

Multidimensional Data Processing With Bayesian Inference via Structural Block Decomposition

Applications of tensor (multiway array) factorizations and decompositions in data mining

Multimodal Co-clustering Analysis of Big Data Based on Matrix and Tensor Decomposition

Tensor Decompositions: A New Concept in Brain Data Analysis?

Tensor Decomposition for Signal Processing and Machine Learning

Tensor decompositions: computations, applications, and challenges

Multiscale Analysis for Higher-order Tensors

Tensor Multi-Clustering Parallel Intelligent Computing Method Based on Tensor Chain Decomposition

A Tensor-Variate Gaussian Process for Classification of Multidimensional Structured Data

Multi-Branch Tensor Network Structure for Tensor-Train Discriminant Analysis

A Tensor-Based Approach for Big Data Representation and Dimensionality Reduction

Scalable Bayesian Tensor Ring Factorization for Multiway Data Analysis

Multiway clustering via tensor block models