Abstract:Summary The performance of sparse stiffness matrix‐vector multiplication is essential for large‐scale structural mechanics numerical simulation. Compressed sparse row (CSR) is the most common format for storing sparse stiffness matrices. However, the high sparsity of the sparse stiffness matrix makes the number of nonzero elements per row very small. Therefore, the CSR‐scalar algorithm, light algorithm, and HOLA algorithm in the calculation will cause some threads in the GPU to be in idle state, which will not only affect the computing performance but also waste computing resources. In this article, a new algorithm, CSR‐vector row, is proposed for fine‐grained computing optimization based on the AMD GPU architecture on heterogeneous supercomputers. This algorithm can set a vector to calculate a row based on the number of nonzero elements of the stiffness matrix. CSR‐vector row has efficient reduce operations, deep memory access optimization, better memory access, and calculation overlapping kernel function configuration scheme. The access bandwidth of the algorithm on AMD GPU is more than 700 GB/s. Compared with CSR‐scalar algorithm, the parallel efficiency of CSR‐vector row is improved by 7.2 times. And floating‐point computing performance is 41%–95% higher than that of light algorithm and HOLA algorithm. In addition, CSR‐vector row is used to calculate the examples from CFD, electromagnetics, quantum chemistry, power network, and semiconductor process, the memory access bandwidth and double floating‐point performance are also improved compared with rocSPARSE‐CSR‐vector.

Adaptive Row-grouped CSR Format for Storing of Sparse Matrices on GPU

New Row-grouped CSR format for storing the sparse matrices on GPU with implementation in CUDA

LSRB-CSR: A Low Overhead Storage Format for SpMV on the GPU Systems

CUDA-based PCG algorithm optimization for a large sparse matrix

AMF-CSR: Adaptive Multi-Row Folding of CSR for SpMV on GPU.

Optimizing sparse matrix-vector multiplication based on gpu

An efficient sparse stiffness matrix vector multiplication using compressed sparse row storage format on AMD GPU

Diagonally-Addressed Matrix Nicknack: How to improve SpMV performance

Dedicated Hardware Accelerators for Processing of Sparse Matrices and Vectors: A Survey

Automatic generation of efficient sparse tensor format conversion routines

Loading Large Sparse Matrices Stored in Files in the Adaptive-Blocking Hierarchical Storage Format

Sparse Matrix Multiplication on CAM Based Accelerator

Optimizing Sparse Linear Algebra Through Automatic Format Selection and Machine Learning

Performance Optimization for Sparse A(T)Ax in Parallel on Multicore Cpu

Performance Modeling and Optimization of Sparse Matrix-Vector Multiplication on NVIDIA CUDA Platform

Parallel Sparse Matrix Multiplication for Preconditioning and SSTA on a Many-Core Architecture

Efficient Algorithm Design of Optimizing SpMV on GPU.

MMSparse: 2D Partitioning of Sparse Matrix Based on Mathematical Morphology

DBCSR: A Library for Dense Matrix Multiplications on Distributed GPU-Accelerated Systems

Fast inference with Kronecker-sparse matrices

dCSR: A Memory-Efficient Sparse Matrix Representation for Parallel Neural Network Inference