Tensor decompositions: computations, applications, and challenges
Yingyue Bi,Yingcong Lu,Zhen Long,Ce Zhu,Yipeng Liu
DOI: https://doi.org/10.1016/b978-0-12-824447-0.00007-8
2022-01-01
Abstract:Many classical data processing techniques rely on the representation and computation of vector and matrix forms, where the vectorization or matricization is often employed on multidimensional data. However, during this process, vital underlying structure information can be lost, leading to suboptimal performances in processing. As a natural representation for multidimensional data, the tensor has drawn a great deal of attention over the past several years. Tensor decompositions are effective tools for tensor analysis. They have been intensively investigated in a number of areas, such as signal processing, machine learning, neuroscience, communication, psychometrics, chemometrics, biometrics, quantum physics, and quantum chemistry. In this chapter, we give a brief introduction into the basic operations of tensors and illustrate them with a few examples in data processing. To better manipulate tensor data, a number of tensor operators are defined, especially different tensor products. In addition, we elaborate on a series of important tensor decompositions and their properties, including CANDECOMP/PARAFAC decomposition, Tucker decomposition, tensor singular value decomposition, block term decomposition, tensor tree decomposition, tensor train decomposition, and tensor ring decomposition. We further present a list of machine learning techniques based on tensor decompositions, such as tensor dictionary learning, tensor completion, robust tensor principal component analysis, tensor regression, statistical tensor classification, coupled tensor fusion, and deep tensor neural networks. Finally, we discuss the challenges and opportunities for data processing under a tensor scheme.