Abstract:In recent years, tensor computation has become a promising tool for solving big data analysis, machine learning, medical image, and EDA problems. To ease the memory and computation intensity of tensor processing, decomposition techniques, especially tensor-train decomposition (TTD), are widely adopted to compress the extremely high-dimensional tensor data. Despite TTD’s potential to break the curse of dimensionality, researchers have not yet leveraged its full computational potential, mainly because of two reasons: 1) executing TTD itself is time- and energy-consuming due to the singular value decomposition (SVD) operation inside each of TTD’s iteration and 2) additional software/hardware optimizations are often required to process the obtained TT-format data in certain applications such as deep learning inference. In this article, we address these challenges with two approaches. First, we propose an algorithm-hardware co-design with customized architecture, namely, TTD Engine to accelerate TTD. We use MRI image compression as a demo application to illustrate the efficacy of the proposed accelerator. Second, we present a case study demonstrating the benefit of TT-format data processing and the efficacy of using TTD Engine. In the case study, we use the TT approach to realize convolution operation, which is difficult and nontrivial for TT-format data. Experimental results show that, TTD Engine achieves, on average, $14.9 \times $ – $36.9 \times $ speedup over CPU implementations and $4.1\times $ – $9.9\times $ speedup compared to the GPU baseline. The energy efficiency is also improved by at least $14.4\times $ and $5.4\times $ over CPU and GPU, respectively. Moreover, our hardware-enabled TT-format data processing further leads to more efficient implementations of complicated operations and applications.

EinDecomp: Decomposition of Declaratively-Specified Machine Learning and Numerical Computations for Parallel Execution

Large Scale Numerical Simulation Via Parallelization and Reconfigurable Computing Hardware

Deinsum: Practically I/O Optimal Multilinear Algebra

Software for Sparse Tensor Decomposition on Emerging Computing Architectures

Full Version: (De/Re)-Composition of Data-Parallel Computations via Multi-Dimensional Homomorphisms

Scalable CP Decomposition for Tensor Learning using GPU Tensor Cores

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

Parallel Computation Method For Solving Large Scale Equation-Oriented Models

Hardware-Enabled Efficient Data Processing with Tensor-Train Decomposition

Parallel Sparse Tensor Decomposition in Chapel

Generalized Higher-Order Tensor Decomposition via Parallel ADMM

Efficient Processing of Sparse Tensor Decomposition via Unified Abstraction and PE-Interactive Architecture

Distributed-Memory Randomized Algorithms for Sparse Tensor CP Decomposition

GOURD: Tensorizing Streaming Applications to Generate Multi-Instance Compute Platforms

Optimizing DNN Compilation for Distributed Training with Joint OP and Tensor Fusion

Swtensor: Accelerating Tensor Decomposition on Sunway Architecture

Tensor Decompositions and Adiabatic Quantum Computing for Discovering Practical Matrix Multiplication Algorithms

Introduction to Tensor Decompositions and their Applications in Machine Learning

Revisiting Deep Learning Parallelism: Fine-Grained Inference Engine Utilizing Online Arithmetic

ExeDec: Execution Decomposition for Compositional Generalization in Neural Program Synthesis