Abstract:In recent years, tensor computation has become a promising tool for solving big data analysis, machine learning, medical image, and EDA problems. To ease the memory and computation intensity of tensor processing, decomposition techniques, especially tensor-train decomposition (TTD), are widely adopted to compress the extremely high-dimensional tensor data. Despite TTD’s potential to break the curse of dimensionality, researchers have not yet leveraged its full computational potential, mainly because of two reasons: 1) executing TTD itself is time- and energy-consuming due to the singular value decomposition (SVD) operation inside each of TTD’s iteration and 2) additional software/hardware optimizations are often required to process the obtained TT-format data in certain applications such as deep learning inference. In this article, we address these challenges with two approaches. First, we propose an algorithm-hardware co-design with customized architecture, namely, TTD Engine to accelerate TTD. We use MRI image compression as a demo application to illustrate the efficacy of the proposed accelerator. Second, we present a case study demonstrating the benefit of TT-format data processing and the efficacy of using TTD Engine. In the case study, we use the TT approach to realize convolution operation, which is difficult and nontrivial for TT-format data. Experimental results show that, TTD Engine achieves, on average, $14.9 \times $ – $36.9 \times $ speedup over CPU implementations and $4.1\times $ – $9.9\times $ speedup compared to the GPU baseline. The energy efficiency is also improved by at least $14.4\times $ and $5.4\times $ over CPU and GPU, respectively. Moreover, our hardware-enabled TT-format data processing further leads to more efficient implementations of complicated operations and applications.

Tensor-Train-Based High-Order Dominant Eigen Decomposition for Multimodal Prediction Services

Tensor-Train-Based Incremental High Order Dominant Z-Eigen Decomposition for Multi-Modal Intelligent Transportation Prediction

Tensor-Train-Based Higher Order Dominant Z-Eigen Decomposition for Multi-modal Prediction and Its Cloud/Edge Implementation

Tensor-Train-Based Multiuser Multivariate Multiorder Physical Markov Process Informed Multimodal Prediction for Industrial Trajectory Applications

A Non-Local Grouping Tensor Train Decomposition Model for Travel Demand Analysis Concerning Categorical Independent Variables

A Distributed Tensor-Train Decomposition Method for Cyber-Physical-Social Services.

Era of Big Data Processing: A New Approach via Tensor Networks and Tensor Decompositions

Tensor Train-Based Multiple Clusterings for Big Data in Cyber-Physical-Social Systems and Its Efficient Implementations

Scalable Tensor-Train-Based Tensor Computations for Cyber-Physical-Social Big Data

Distributed Non-Negative Tensor Train Decomposition

Efficient Nonparametric Tensor Decomposition for Binary and Count Data

TT-TSVD: A Multi-modal Tensor Train Decomposition with Its Application in Convolutional Neural Networks for Smart Healthcare

Tensor-Train Networks for Learning Predictive Modeling of Multidimensional Data

Tensor Multi-Clustering Parallel Intelligent Computing Method Based on Tensor Chain Decomposition

A Tensor-Based Approach for Big Data Representation and Dimensionality Reduction

Essential tensor learning for multimodal information-driven stock movement prediction

Hardware-Enabled Efficient Data Processing with Tensor-Train Decomposition

Multivariate Multi-Order Markov Multi-Modal Prediction with Its Applications in Network Traffic Management

Multi-Dictionary Tensor Decomposition

A Tensor Computation and Optimization Model for Cyber-Physical-Social Big Data

Distributed memory parallel adaptive tensor-train cross approximation