Abstract:In recent years, tensor computation has become a promising tool for solving big data analysis, machine learning, medical image, and EDA problems. To ease the memory and computation intensity of tensor processing, decomposition techniques, especially tensor-train decomposition (TTD), are widely adopted to compress the extremely high-dimensional tensor data. Despite TTD’s potential to break the curse of dimensionality, researchers have not yet leveraged its full computational potential, mainly because of two reasons: 1) executing TTD itself is time- and energy-consuming due to the singular value decomposition (SVD) operation inside each of TTD’s iteration and 2) additional software/hardware optimizations are often required to process the obtained TT-format data in certain applications such as deep learning inference. In this article, we address these challenges with two approaches. First, we propose an algorithm-hardware co-design with customized architecture, namely, TTD Engine to accelerate TTD. We use MRI image compression as a demo application to illustrate the efficacy of the proposed accelerator. Second, we present a case study demonstrating the benefit of TT-format data processing and the efficacy of using TTD Engine. In the case study, we use the TT approach to realize convolution operation, which is difficult and nontrivial for TT-format data. Experimental results show that, TTD Engine achieves, on average, $14.9 \times $ – $36.9 \times $ speedup over CPU implementations and $4.1\times $ – $9.9\times $ speedup compared to the GPU baseline. The energy efficiency is also improved by at least $14.4\times $ and $5.4\times $ over CPU and GPU, respectively. Moreover, our hardware-enabled TT-format data processing further leads to more efficient implementations of complicated operations and applications.

A Pipeline Computing Method of SpTV for Three-Order Tensors on CPU and GPU

IAP-SpTV: An Input-aware Adaptive Pipeline SpTV via GCN on CPU-GPU

Aesptv: an Adaptive and Efficient Framework for Sparse Tensor-Vector Product Kernel on a High-Performance Computing Platform

A Heterogeneous Parallel Computing Approach Optimizing SpTTM on CPU-GPU Via GCN

A Novel Parallel Algorithm for Sparse Tensor Matrix Chain Multiplication via TCU-Acceleration

Optimizing Sparse Tensor Times Matrix on Multi-Core and Many-Core Architectures

cuFasterTucker: A Stochastic Optimization Strategy for Parallel Sparse FastTucker Decomposition on GPU Platform

Efficient Utilization of Multi-Threading Parallelism on Heterogeneous Systems for Sparse Tensor Contraction

Efficient Computation of Tucker Decomposition for Streaming Scientific Data Compression

Static and Streaming Tucker Decomposition for Dense Tensors

Optimizing Sparse Tensor Times Matrix on GPUs

Efficient Processing of Sparse Tensor Decomposition via Unified Abstraction and PE-Interactive Architecture

Sparse Tucker Tensor Decomposition on a Hybrid FPGA-CPU Platform

cuFastTuckerPlus: A Stochastic Parallel Sparse FastTucker Decomposition Using GPU Tensor Cores

Tucker Tensor Decomposition on FPGA

Parallel algorithms for computing the tensor-train decomposition

Cufasttucker: A Novel Sparse FastTucker Decomposition for HHLST on Multi-GPUs

High-Performance Tensor Learning Primitives Using GPU Tensor Cores

Towards Optimized Streaming Tensor Completion on multiple GPUs.

Hardware-Enabled Efficient Data Processing with Tensor-Train Decomposition

Scalable CP Decomposition for Tensor Learning using GPU Tensor Cores