Abstract:Sparse matrix-vector multiplication (SpMV) plays a critical role in a wide range of linear algebra computations, particularly in scientific and engineering disciplines. However, the irregular memory access patterns, extensive memory usage, high bandwidth requirements, and underutilization of parallelism hinder the computational efficiency of SpMV on GPUs. In this paper, we propose a novel approach called block-wise dynamic mixed-precision (BDMP) to address these challenges. Our methodology involves partitioning the original matrix into uniformly sized blocks, with each block's size determined by considering architectural characteristics and accuracy requirements. Additionally, we dynamically assign precision to each block using a precision selection method that takes into account the value distribution of the original sparse matrix. We develop two distinct SpMV computation algorithms for BDMP: BDMP-PBP (Precision-based partitioning) and BDMP-TCKI (Tailored compression and kernel implementation). BDMP-PBP partitions the matrix into two independent matrices for separate computations based on block precision, offering flexibility for integration with other optimization techniques. Meanwhile, BDMP-TCKI focuses on achieving significant thread-level parallelism and memory utilization by tailoring an appropriate compressed storage format and kernel implementation for each block. We compare BDMP with NVIDIA's cuSPARSE library and three state-of-the-art SpMV methods, including SELLP, MergeBase, and BalanceCSR, using matrices from the University of Florida's SuiteSparse dataset collection. BDMP-PBP and BDMP-TCKI show average speedups up to 2.64 and 2.91 on Turing RTX 2080Ti, and up to 2.99 and 3.22 on Ampere A100. The results demonstrate that BDMP enables the optimization of computation speed without compromising the precision necessary for reliable results.

Performance evaluation of accelerated real and complex multiple-precision sparse matrix-vector multiplication

Acceleration of complex matrix multiplication using arbitrary precision floating-point arithmetic

Acceleration of multiple precision matrix multiplication based on multi-component floating-point arithmetic using AVX2

Performance Analysis and Optimization of Sparse Matrix-Vector Multiplication on Modern Multi- and Many-Core Processors

Performance evaluation of accelerated complex multiple-precision LU decomposition

Accelerated Multiple Precision Matrix Multiplication using Strassen's Algorithm and Winograd's Variant

A Comprehensive Performance Model of Sparse Matrix-Vector Multiplication to Guide Kernel Optimization

A lightweight optimization selection method for Sparse Matrix-Vector Multiplication

Improvement of Sparse Matrix-Vector Multiplication on GPU

Computing the sparse matrix vector product using block-based kernels without zero padding on processors with AVX-512 instructions

Automatic Tuning of Sparse Matrix-Vector Multiplication on Multicore Clusters.

Accelerated Multiple Precision Direct Method and Mixed Precision Iterative Refinement on Python Programming Environment

Performance Portability of Sparse Block Diagonal Matrix Multiple Vector Multiplications on GPUs

Block-wise dynamic mixed-precision for sparse matrix-vector multiplication on GPUs

Smat: An Input Adaptive Auto-Tuner For Sparse Matrix-Vector Multiplication

Efficient sparse-matrix multi-vector product on GPUs

Feature-based SpMV Performance Analysis on Contemporary Devices

Tuning Technique for Multiple Precision Dense Matrix Multiplication using Prediction of Computational Time

An Integral-equation-oriented Vectorized SpMV Algorithm and Its Application on CT Imaging Reconstruction

Sparse Matrix-Vector Multiplication Optimizations based on Matrix Bandwidth Reduction using NVIDIA CUDA

A method for accelerating low precision operations by sparse matrix multiplication