Abstract:Sparse triangular solve（SpTRSV） is a vital operation in preconditioners. In particular, in scientific computing program that solves partial differential equation systems iteratively, structured SpTRSV is a common type of issue and often a performance bottleneck that needs to be addressed by the scientific computing program. The commercial mathematical libraries tailored to the graphics processing unit（GPU） platform, represented by CUSPARSE, parallelize SpTRSV operations by level-scheduling methods. However, this method is weakened by time-consuming preprocessing and serious GPU thread idle when it is employed to deal with structured SpTRSV issues. This study proposes a parallel algorithm tailored to structured SpTRSV issues. The proposed algorithm leverages the special non-zero element distribution pattern of structured SpTRSV issues during task allocation to skip the preprocessing and analysis of the non-zero element structure of the input issue. Furthermore, the element-wise operation strategy used in the existing level-scheduling methods is modified. As a result, the problem of GPU thread idle is effectively alleviated, and the memory access latency of some non-zero elements in the matrix is concealed. This study also adopts a state variable compression technique according to the task allocation characteristics of the proposed algorithm, significantly improving the cache hit rate of the algorithm in state variable operations. Additionally, several hardware features of the GPU, including predicated execution, are investigated to comprehensively optimize algorithm implementation. The proposed algorithm is tested on NVIDIA V100 GPU, achieving an average 2.71× acceleration over CUSPARSE and a peak effective memory-access bandwidth of 225.2 GB/s. The modified element-wise operation strategy, combined with a series of other optimization measures for GPU hardware, attains a prominent optimization effect by yielding a nearly115% increase in the effective memory-access bandwidth of the proposed algorithm.

A Compressed Simplex Method Based on GPU

Matrix Decomposition Graphics Processing Unit Solver for Poisson Image Editing

Linear Programming Computation Model Based on Dpvm

Revised Simplex Algorithm for Linear Programming on GPUs with CUDA

Implementing Two Compressed Sensing Algorithms on GPU

A GPU-Based Parallel Algorithm for Large Scale Linear Programming Problem

Atomic Reduction Based Sparse Matrix-Transpose Vector Multiplication on GPUs

Optimizing Algorithm of Sparse Linear Systems on GPU

CUDA-based PCG algorithm optimization for a large sparse matrix

Towards Optimal Fast Matrix Multiplication on CPU-GPU Platforms

Linear Bregman Algorithm Implemented in Parallel Gpu

TaiChi: A Hybrid Compression Format for Binary Sparse Matrix-Vector Multiplication on GPU

GPU Implementation of Conjugate Gradient Method

Compressed Basis GMRES on High Performance GPUs

A Hybrid CPU-GPU Multifrontal Optimizing Method in Sparse Cholesky Factorization

Parallel Structured Sparse Triangular Solver for GPU Platform

Optimizing sparse matrix-vector multiplication based on gpu

A Mixed-Integer Quadratic Programming Solver Based on Gpu

GPU-based multifrontal optimizing method in sparse Cholesky factorization

Parallel L-BFGS-B Algorithm on GPU.

Accelerating Pqmrcgstab Algorithm On Gpu