Abstract:Summary The performance of sparse stiffness matrix‐vector multiplication is essential for large‐scale structural mechanics numerical simulation. Compressed sparse row (CSR) is the most common format for storing sparse stiffness matrices. However, the high sparsity of the sparse stiffness matrix makes the number of nonzero elements per row very small. Therefore, the CSR‐scalar algorithm, light algorithm, and HOLA algorithm in the calculation will cause some threads in the GPU to be in idle state, which will not only affect the computing performance but also waste computing resources. In this article, a new algorithm, CSR‐vector row, is proposed for fine‐grained computing optimization based on the AMD GPU architecture on heterogeneous supercomputers. This algorithm can set a vector to calculate a row based on the number of nonzero elements of the stiffness matrix. CSR‐vector row has efficient reduce operations, deep memory access optimization, better memory access, and calculation overlapping kernel function configuration scheme. The access bandwidth of the algorithm on AMD GPU is more than 700 GB/s. Compared with CSR‐scalar algorithm, the parallel efficiency of CSR‐vector row is improved by 7.2 times. And floating‐point computing performance is 41%–95% higher than that of light algorithm and HOLA algorithm. In addition, CSR‐vector row is used to calculate the examples from CFD, electromagnetics, quantum chemistry, power network, and semiconductor process, the memory access bandwidth and double floating‐point performance are also improved compared with rocSPARSE‐CSR‐vector.

New Row-grouped CSR format for storing the sparse matrices on GPU with implementation in CUDA

Adaptive Row-grouped CSR Format for Storing of Sparse Matrices on GPU

LSRB-CSR: A Low Overhead Storage Format for SpMV on the GPU Systems

CUDA-based PCG algorithm optimization for a large sparse matrix

Optimizing sparse matrix-vector multiplication based on gpu

AMF-CSR: Adaptive Multi-Row Folding of CSR for SpMV on GPU.

An efficient sparse stiffness matrix vector multiplication using compressed sparse row storage format on AMD GPU

Diagonally-Addressed Matrix Nicknack: How to improve SpMV performance

Loading Large Sparse Matrices Stored in Files in the Adaptive-Blocking Hierarchical Storage Format

Performance Modeling and Optimization of Sparse Matrix-Vector Multiplication on NVIDIA CUDA Platform

Dedicated Hardware Accelerators for Processing of Sparse Matrices and Vectors: A Survey

Optimized Sparse Matrix Operations for Reverse Mode Automatic Differentiation

DBCSR: A Library for Dense Matrix Multiplications on Distributed GPU-Accelerated Systems

MMSparse: 2D Partitioning of Sparse Matrix Based on Mathematical Morphology

TaiChi: A Hybrid Compression Format for Binary Sparse Matrix-Vector Multiplication on GPU

dCSR: A Memory-Efficient Sparse Matrix Representation for Parallel Neural Network Inference

Tensor Core-Adapted Sparse Matrix Multiplication for Accelerating Sparse Deep Neural Networks

Parallel Sparse Matrix Multiplication for Preconditioning and SSTA on a Many-Core Architecture

An Optimized GP-GPU Warp Scheduling Algorithm for Sparse Matrix-Vector Multiplication

Efficient Algorithm Design of Optimizing SpMV on GPU.

Automatic generation of efficient sparse tensor format conversion routines