Abstract:With the advent of high-dimensional data, tensor and tensor decomposition methods have received widespread attention in the field of data analysis. However, the high-dimensional and sparse characteristics of tensor data lead to the high computation complexity of algorithm, which became an obstacle to the actual application of the tensor decomposition algorithm. In this paper, we start from the high sparsity of real tensor, and give a GPU parallel sparse tensor CP decomposition algorithm called ParSCP-ALS. Introduction In the past ten years, the tensor and tensor decomposition have become popular in high-dimensional data analysis. The tensor decomposition method is similar to matrix decomposition, which can map high-dimensional data to a lower subspace, while reducing the dimension of data. So far, tensor and tensor decomposition have applied in many fields, such as signal processing, computer vision, data mining, graph analysis, etc.[1] Due to the high-dimensional nature of tensor, all tensor decomposition algorithms have high computation complexity. At the same time, the high-dimensional data, such as DBLP[2] and Moivlens dataset[3], are always sparse, and the size of data grows exponentially with the dimension. The efficiency of algorithm and sparseness of large-scale data prevent tensor decomposition for further application in practical. To solve these problems of tensor decomposition, many researchers have made several improvements. Papalexakis et al [4] proposed the ParCube algorithm and Antikainen et al [5] speed up the decomposition of non-negative tensors with GPU. The existing research results show that the GPU parallel computing method can effectively accelerate the tensor decomposition algorithm. In this paper, aiming at the high sparsity of tensor data, which is the most significant feature of real high-dimensional data, we proposed an algorithm called ParSCP-ALS, which improved the CP-ALS algorithm for CP decomposition and use GPU to accelerate the algorithm at the same time. The rest of this paper is organized as follow. Section 2 reviews the CP decomposition and CP-ALS algorithm. Section 3 introduces the proposed ParSCP-ALS algorithm, including the improvement of the traditional algorithm, the data structure for sparse data and the parallelization on GPU. Section 4 presents the experiment result on DBLP and Movielens dataset. Background Knowledge Tensor and matricization A tensor is a mathematical representation of multi-way arrays. The dimension of tensor is defined as order or mode. In this paper, we use X as a tensor, A as a matrix, and x as a vector. The

A Novel Parallel Algorithm for Sparse Tensor Matrix Chain Multiplication via TCU-Acceleration

Optimizing Sparse Tensor Times Matrix on Multi-Core and Many-Core Architectures

BCB-SpTC: An Efficient Sparse High-Dimensional Tensor Contraction Employing Tensor Core Acceleration

Tensor Core-Adapted Sparse Matrix Multiplication for Accelerating Sparse Deep Neural Networks

A Heterogeneous Parallel Computing Approach Optimizing SpTTM on CPU-GPU Via GCN

Optimizing Sparse Tensor Times Matrix on GPUs

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Releasing the Potential of Tensor Core for Unstructured SpMM Using Tiled-CSR Format

Tpspmv: A Two-Phase Large-Scale Sparse Matrix-Vector Multiplication Kernel for Manycore Architectures

Efficient Utilization of Multi-Threading Parallelism on Heterogeneous Systems for Sparse Tensor Contraction

TSTC: Two-Level Sparsity Tensor Core Enabling Both Algorithm Flexibility and Hardware Efficiency

Exploiting Hierarchical Parallelism and Reusability in Tensor Kernel Processing on Heterogeneous HPC Systems

Sparse MTTKRP Acceleration for Tensor Decomposition on GPU

High Performance Unstructured SpMM Computation Using Tensor Cores

Performance Optimization for Sparse A(T)Ax in Parallel on Multicore Cpu

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Efficient Processing of Sparse Tensor Decomposition via Unified Abstraction and PE-Interactive Architecture

A Parallel CP Decomposition Algorithm for Sparse Tensor

Atomic Reduction Based Sparse Matrix-Transpose Vector Multiplication on GPUs

TaiChi: A Hybrid Compression Format for Binary Sparse Matrix-Vector Multiplication on GPU

Software for Sparse Tensor Decomposition on Emerging Computing Architectures