Abstract:Sparse matrix-vector multiplication (SpMV) plays a critical role in a wide range of linear algebra computations, particularly in scientific and engineering disciplines. However, the irregular memory access patterns, extensive memory usage, high bandwidth requirements, and underutilization of parallelism hinder the computational efficiency of SpMV on GPUs. In this paper, we propose a novel approach called block-wise dynamic mixed-precision (BDMP) to address these challenges. Our methodology involves partitioning the original matrix into uniformly sized blocks, with each block's size determined by considering architectural characteristics and accuracy requirements. Additionally, we dynamically assign precision to each block using a precision selection method that takes into account the value distribution of the original sparse matrix. We develop two distinct SpMV computation algorithms for BDMP: BDMP-PBP (Precision-based partitioning) and BDMP-TCKI (Tailored compression and kernel implementation). BDMP-PBP partitions the matrix into two independent matrices for separate computations based on block precision, offering flexibility for integration with other optimization techniques. Meanwhile, BDMP-TCKI focuses on achieving significant thread-level parallelism and memory utilization by tailoring an appropriate compressed storage format and kernel implementation for each block. We compare BDMP with NVIDIA's cuSPARSE library and three state-of-the-art SpMV methods, including SELLP, MergeBase, and BalanceCSR, using matrices from the University of Florida's SuiteSparse dataset collection. BDMP-PBP and BDMP-TCKI show average speedups up to 2.64 and 2.91 on Turing RTX 2080Ti, and up to 2.99 and 3.22 on Ampere A100. The results demonstrate that BDMP enables the optimization of computation speed without compromising the precision necessary for reliable results.

RDMA-Based Algorithms for Sparse Matrix Multiplication on GPUs

A sparsity-aware distributed-memory algorithm for sparse-sparse matrix multiplication

Distributed-Memory Parallel Algorithms for Sparse Matrix and Sparse Tall-and-Skinny Matrix Multiplication

Accelerating Sparse Approximate Matrix Multiplication on GPUs

Parallel Sparse Matrix-Matrix Multiplication and Indexing: Implementation and Experiments

Block-wise dynamic mixed-precision for sparse matrix-vector multiplication on GPUs

Efficient Sparse Matrix Kernels based on Adaptive Workload-Balancing and Parallel-Reduction

Parallel Efficient Sparse Matrix-Matrix Multiplication on Multicore Platforms

Accelerating approximate matrix multiplication for near-sparse matrices on GPUs

Optimizing sparse matrix-vector multiplication based on gpu

Performance Portability of Sparse Block Diagonal Matrix Multiple Vector Multiplications on GPUs

Efficient Algorithm Design of Optimizing SpMV on GPU.

A Row Decomposition-based Approach for Sparse Matrix Multiplication on GPUs.

Exploring the Design Space of Distributed Parallel Sparse Matrix-Multiple Vector Multiplication

Register-Aware Optimizations for Parallel Sparse Matrix–Matrix Multiplication

Parallel optimization for sparse matrix-vector on GPU

Register-based Implementation of the Sparse General Matrix-Matrix Multiplication on GPUs

Efficient sparse-matrix multi-vector product on GPUs

A New Sparse Matrix Vector Multiplication GPU Algorithm Designed for Finite Element Problems

Optimizing sparse general matrix–matrix multiplication for DCUs

Improvement of Sparse Matrix-Vector Multiplication on GPU