Adaptive diagonal sparse matrix-vector multiplication on GPU

Jiaquan Gao,Yifei Xia,Renjie Yin,Guixia He

DOI: https://doi.org/10.1016/j.jpdc.2021.07.007

IF: 4.542

2021-01-01

Journal of Parallel and Distributed Computing

Abstract:•Two new sparse storage formats BRCSD-I and BRCSD-II are proposed.•A search engine is proposed to identify the type of diagonal sparse matrices.•An adaptive SpMV algorithm for diagonal sparse matrices on GPU is presented.

What problem does this paper attempt to address?

Yet Another Hybrid Strategy for Auto-tuning SpMV on GPUs

Zhaohui Wang,Xiaojie Qiu,Aimin Zhang,Yichao Cheng,Yi Peng,Sun

DOI: https://doi.org/10.14257/ijseia.2015.9.5.10

2015-01-01

International Journal of Software Engineering and Its Applications

Abstract:Sparse matrix-vector multiplication (SpMV) is a key linear algebra algorithm and is widely used in many application domains. Besides multi-core architecture, there is also extensive research focusing on accelerating SpMV on many-core Graphics Processing Units (GPUs). SpMV computations have many indirect and irregular memory accesses, and load imbalance could occur while mapping computations onto single-instruction, multiple-data (SIMD) GPUs. SpMV is highly memory bandwidth-bound, though GPUs have massive computational resources, the performance of SpMV on GPUs is still unsatisfying. In this paper, we present a new hybrid strategy for auto-tuning SpMV on GPUs. Our strategy combines the advantages of row-major storage and column-major storage. Like many other strategies, we reordered a given sparse matrix according to row lengths in decreasing order. In order to be more adaptive and efficient, we proposed a new hybrid Blocked CSR and JDS (BCJ) format based on original CSR and JDS. BCJ splits a sparse matrix into a denser part and a sparser part after reordering and uses different kernels to process the corresponding part. And we proposed corresponding auto-tuning framework to help transforming matrix and launching kernels according to the sparsity characteristics of the matrix. A CUDA implementation of BCJ outperforms the original formats significantly on a broad range of unstructured sparse matrices.
TaiChi: A Hybrid Compression Format for Binary Sparse Matrix-Vector Multiplication on GPU

Jianhua Gao,Weixing Ji,Zhaonian Tan,Yizhuo Wang,Feng Shi

DOI: https://doi.org/10.1109/tpds.2022.3170501

IF: 5.3

2022-01-01

IEEE Transactions on Parallel and Distributed Systems

Abstract:Binary Sparse Matrix-Vector Multiplication (SpMV) is a heavy computational kernel in weblink analysis, integer factorization, compressed sensing, spectral graph theory, and other domains. Testing several popular GPU-based SpMV implementations on 400 sparse matrices, we observed that data transfer to GPU memory accounts for a large part of the total computation time. The transfer of constant value "1"s can be easily eliminated for binary sparse matrices. However, compressing index arrays has always been a great challenge. This article proposes a new compression format TaiChi to further reduce index data copies and improve the performance of SpMV, especially for diagonally dominant binary sparse matrices. Input matrices are first partitioned into relatively dense and ultra-sparse areas. Then the dense areas are encoded inversely by marking "0"s, while the ultra-sparse area is encoded by marking "1"s. We also designed a new SpMV algorithm only using addition and subtraction for binary matrices based on our partition and encoding format. Evaluation results on real-world binary sparse matrices show that our hybrid encoding for binary matrix significantly reduces the data transfer and speeds up the kernel execution. It achieves the highest transfer and kernel execution speedups of 5.63x and 3.84x on GTX 1080 Ti, 3.39x and 3.91x on Tesla V100.

computer science, theory & methods,engineering, electrical & electronic
Accelerating Sparse Matrix Vector Multiplication on Many-Core GPUs

Wei Xu,Zhiyong Liu,Dongrui Fan,Shuai Jiao,Xiaochun Ye,Fenglong Song,Chenggang Yan

2012-01-01

Abstract:Many-core GPUs provide high computing ability and substantial bandwidth; however, optimizing irregular applications like SpMV on GPUs becomes a difficult but meaningful task. In this paper, we propose a novel method to improve the performance of SpMV on GPUs. A new storage format called HYB-R is proposed to exploit GPU architecture more efficiently. The COO portion of the matrix is partitioned recursively into a ELL portion and a COO portion in the process of creating HYB-R format to ensure that there are as many non-zeros as possible in ELL format. The method of partitioning the matrix is an important problem for HYB-R kernel, so we also try to tune the parameters to partition the matrix for higher performance. Experimental results show that our method can get better performance than the fastest kernel (HYB) in NVIDIA’s SpMV library with as high as 17% speedup. Keywords—GPU, HYB-R, Many-core, Performance Tuning, SpMV
Implementing Sparse Matrix-Vector Multiplication Using CUDA Based on a Hybrid Sparse Matrix Format

Wei Cao,Lu Yao,Zongzhe Li,Yongxian Wang

DOI: https://doi.org/10.1109/iccasm.2010.5623237

2010-01-01

Abstract:The Sparse Matrix-Vector product (SpMV) is a key operation in engineering and scientific computing. Methods for efficiently implementing it in parallel are critical to the performance of many applications. Modern Graphics Processing Units (GPUs) coupled with the advent of general purpose programming environments like NVIDIA's CUDA, have gained interest as a viable architecture for data-parallel general purpose computations. Currently, SpMV implementations using CUDA based on common sparse matrix format have already appeared. Among them, the performance of implementation based on ELLPACK-R format is the best. However, in this implementation, when the maximum number of nonzeros per row does substantially differ from the average, thread is suffering from load imbalance. This paper proposes a new matrix storage format called ELLPACK-RP, which combines ELLPACK-R format with JAD format, and implements the SpMV using CUDA based on it. The result proves that it can decrease the load imbalance and improve the SpMV performance efficiently.
Optimizing sparse matrix-vector multiplication based on gpu

MENGJIA YIN,TAO ZHANG,XU XIANBIN,HU JIN,HE SHUIBING

2012-01-01

Abstract:In recent years, Graphics Processing Units(GPUs) have attracted the attention of many application developers as powerful massively parallel system. Computer Unified Device Architecture (CUDA) as a general purpose parallel computing architecture makes GPUs an appealing choice to solve many complex computational problems in a more efficient way. Sparse Matrix-vector Multiplication(SpMV) algorithm is one of the most important scientific computing kernel algorithms. In this paper, we proposed new parallelization algorithms that CSR-M based on CSR format and ELLPACK-R based on ELLPACK format, which are realized the parallelism kernel on GPU with CUDA. We discussed implementing optimizing SpMV on GPUs using CUDA programming model, the optimization strategies including: mapping thread, mergering access, reusing data, avoiding branch, optimization thread block. The experiment results showed the proposed optimization strategies can improve performance, memory bandwidth and reduce the execution time of kernel.
Optimization of Sparse Matrix-Vector Multiplication with Variant CSR on GPUs

Xiaowen Feng,Hai Jin,Ran Zheng,Kan Hu,Jingxiang Zeng,Zhiyuan Shao

DOI: https://doi.org/10.1109/ICPADS.2011.91

2011-01-01

Abstract:Sparse Matrix-Vector multiplication (SpMV) is one of the most significant yet challenging issues in computational science area. It is a memory-bound application whose performance mostly depends on the input matrix and the underlying architecture. Many researchers have paid more attentions on exploring a variety of optimization techniques to SpMV. One of the most promising respects is how to adapt the storage format to satisfy the underlying architecture. Alterative storage formats can largely lessen memory pressure, however, the computational resources are often underutilized. Therefore, a new storage format, which is called Compressed Sparse Row with Segmented Interleave Combination (SIC), is proposed. Stemming from Compressed Sparse Row format (CSR), SIC format employs an interleave combination pattern that combines certain amount of CSR rows to form a new SIC row. In order to further improve performance, segmented processing is also brought in. According to the empirical data, we also develop an automatic SIC-based SpMV suitable for all the matrices. Experimental results show that our approach outperforms the NVIDIA CSR vector kernel, achieving up to 12.6 × speedup. It also demonstrates a comparable performance with the Hybrid format, even with the highest 2.89 × speedup.
Diagonally-Addressed Matrix Nicknack: How to improve SpMV performance

Jens Saak,Jonas Schulze

2023-07-13

Abstract:We suggest a technique to reduce the storage size of sparse matrices at no loss of information. We call this technique Diagonally-Adressed (DA) storage. It exploits the typically low matrix bandwidth of matrices arising in applications. For memory-bound algorithms, this traffic reduction has direct benefits for both uni-precision and multi-precision algorithms. In particular, we demonstrate how to apply DA storage to the Compressed Sparse Rows (CSR) format and compare the performance in computing the Sparse Matrix Vector (SpMV) product, which is a basic building block of many iterative algorithms. We investigate 1367 matrices from the SuiteSparse Matrix Collection fitting into the CSR format using signed 32 bit indices. More than 95% of these matrices fit into the DA-CSR format using 16 bit column indices, potentially after Reverse Cuthill-McKee (RCM) reordering. Using IEEE 754 double precision scalars, we observe a performance uplift of 11% (single-threaded) or 17.5% (multithreaded) on average when the traffic exceeds the size of the last-level CPU cache. The predicted uplift in this scenario is 20%. For traffic within the CPU's combined level 2 and level 3 caches, the multithreaded performance uplift is over 40% for a few test matrices.

Numerical Analysis,Data Structures and Algorithms,Performance
Adaptive Row-grouped CSR Format for Storing of Sparse Matrices on GPU

Martin Heller,Tomáš Oberhuber

DOI: https://doi.org/10.48550/arXiv.1203.5737

2012-03-27

Abstract:We present new adaptive format for storing sparse matrices on GPU. We compare it with several other formats including CUSPARSE which is today probably the best choice for processing of sparse matrices on GPU in CUDA. Contrary to CUSPARSE which works with common CSR format, our new format requires conversion. However, multiplication of sparse-matrix and vector is significantly faster for many atrices. We demonstrate it on set of 1 600 matrices and we show for what types of matrices our format is profitable.

Distributed, Parallel, and Cluster Computing,Data Structures and Algorithms
Block-wise dynamic mixed-precision for sparse matrix-vector multiplication on GPUs

Zhixiang Zhao,Guoyin Zhang,Yanxia Wu,Ruize Hong,Yiqing Yang,Yan Fu

DOI: https://doi.org/10.1007/s11227-024-05949-6

IF: 3.3

2024-03-12

The Journal of Supercomputing

Abstract:Sparse matrix-vector multiplication (SpMV) plays a critical role in a wide range of linear algebra computations, particularly in scientific and engineering disciplines. However, the irregular memory access patterns, extensive memory usage, high bandwidth requirements, and underutilization of parallelism hinder the computational efficiency of SpMV on GPUs. In this paper, we propose a novel approach called block-wise dynamic mixed-precision (BDMP) to address these challenges. Our methodology involves partitioning the original matrix into uniformly sized blocks, with each block's size determined by considering architectural characteristics and accuracy requirements. Additionally, we dynamically assign precision to each block using a precision selection method that takes into account the value distribution of the original sparse matrix. We develop two distinct SpMV computation algorithms for BDMP: BDMP-PBP (Precision-based partitioning) and BDMP-TCKI (Tailored compression and kernel implementation). BDMP-PBP partitions the matrix into two independent matrices for separate computations based on block precision, offering flexibility for integration with other optimization techniques. Meanwhile, BDMP-TCKI focuses on achieving significant thread-level parallelism and memory utilization by tailoring an appropriate compressed storage format and kernel implementation for each block. We compare BDMP with NVIDIA's cuSPARSE library and three state-of-the-art SpMV methods, including SELLP, MergeBase, and BalanceCSR, using matrices from the University of Florida's SuiteSparse dataset collection. BDMP-PBP and BDMP-TCKI show average speedups up to 2.64 and 2.91 on Turing RTX 2080Ti, and up to 2.99 and 3.22 on Ampere A100. The results demonstrate that BDMP enables the optimization of computation speed without compromising the precision necessary for reliable results.

computer science, theory & methods,engineering, electrical & electronic, hardware & architecture
VBSF: a new storage format for SIMD sparse matrix–vector multiplication on modern processors

Yishui Li,Peizhen Xie,Xinhai Chen,Jie Liu,Bo Yang,Shengguo Li,Chunye Gong,Xinbiao Gan,Han Xu

DOI: https://doi.org/10.1007/s11227-019-02835-4

IF: 3.3

2020-01-01

The Journal of Supercomputing

Abstract:Sparse matrix–vector multiplication (SpMV) is one of the most indispensable kernels of solving problems in numerous applications, but its performance of SpMV is limited by the need for frequent memory access. Modern processors exploit data-level parallelism to improve the performance using single-instruction multiple data (SIMD). In order to take full advantage of SIMD acceleration technology, a new storage format called Variable Blocked-\(\sigma\)-SIMD Format (VBSF) is proposed in this paper to change the irregular nature of traditional matrix storage formats. This format combines the adjacent nonzero elements into variable size blocks to ensure that SpMV can be computed with SIMD vector units. We compare the VBSF-based SpMV with traditional storage formats using 15 matrices as a benchmark suite on three computing platforms (FT2000, Intel Xeon E5 and Intel Silver) with different SIMD length. For the matrices in the benchmark suite, the VBSF obtains great performance improvement on three platforms, respectively, and it proves to have better storage efficiency compared with other storage formats.
Parallel optimization for sparse matrix-vector on GPU

Mengjia Yin,Xianbin Xu,Hua Chen,Shuibing He,Jing Hu

DOI: https://doi.org/10.1007/978-1-4471-4850-0_71

2013-01-01

Abstract:Graphics processing units (GPUs) have been used in the general-purpose computation field. Sparse matrix-vector multiplication (SpMV) algorithm is one of the most important scientific computing kernel algorithms. In this paper, we discuss implementing optimizing sparse matrix-vector multiplication on GPUs using CUDA programming model. We used methods and strategy which including mapping thread, merging access, reusing data, and avoiding the branch. The experimental results show that the optimizations strategy to improve SpMV performance. © 2013 Springer-Verlag.
Efficient Algorithm Design of Optimizing SpMV on GPU.

Genshen Chu,Yuanjie He,Lingyu Dong,Zhezhao Ding,Dandan Chen,He Bai,Xuesong Wang,Changjun Hu

DOI: https://doi.org/10.1145/3588195.3593002

2023-01-01

Abstract:Sparse matrix-vector multiplication (SpMV) is a fundamental building block for various numerical computing applications. However, most existing GPU-SpMV approaches may suffer from either long preprocessing overhead, load imbalance, format conversion, bad memory access patterns. In this paper, we proposed two new SpMV algorithms:flat andline-enhance, as well as their implementations, for GPU systems to overcome the above shortcomings. Our algorithms work directly on the CSR sparse matrix format. To achieve high performance: 1) for load balance, theflat algorithm uses non-zero splitting andline-enhance uses a mix of row and non-zero splitting; 2) memory access patterns are designed for both algorithms for data loading, storing and reduction steps; and 3) an adaptive approach is proposed to select appropriate algorithm and parameters based on matrix characteristics. We evaluate our methods using theSuiteSparse Matrix Collection on AMD and NVIDIA GPU platforms. Average performance improvements of 424%, 741%, 49%, 46%, 72% are achieved when comparing our adaptive approach with CSR-Vector, CSR-Adaptive, HOLA, cuSparse and merge-based SpMV, respectively. In bandwidth tests, our approach can also achieve a high memory bandwidth, which is very close to the peak memory bandwidth.
A Segment‐based Sparse Matrix–vector Multiplication on CUDA

Xiaowen Feng,Hai Jin,Ran Zheng,Zhiyuan Shao,Lei Zhu

DOI: https://doi.org/10.1002/cpe.2978

2012-01-01

Concurrency and Computation Practice and Experience

Abstract:SUMMARYThe challenge for Sparse Matrix–Vector multiplication (SpMV) performance is memory bandwidth, which mostly depends on input matrices and underlying computing platforms. To solve this challenge, many researchers have explored a variety of optimization techniques. One of the most promising aspects focuses on designing storage formats to represent sparse matrices. However, lots of prior storage formats cannot fully take advantage of the underlying computing platforms, resulting in unsatisfactory performance and large memory footprint. Therefore, a novel storage format, called Segmented Hybrid ELL + Compressed Sparse Row (CSR) (SHEC for short), is proposed to further improve the throughput and lessen memory footprint on Graphics Processing Unit (GPU). SHEC format employs an interleaved combination pattern, which combines certain amount of compressed rows to form a new SHEC row. Segmentation is brought in to balance load and reduce memory footprint. According to the empirical data, an automatic SHEC‐based SpMV is developed to fit for all the matrices. Experimental results show that SHEC approach outperforms the best results of NVIDIA SpMV library and exhibits a comparable performance with state‐of‐the‐art storage formats on the standard dataset. Copyright © 2012 John Wiley & Sons, Ltd.
Improvement of Sparse Matrix-Vector Multiplication on GPU

MA Chao,WEI Gang,PEI Song-Wen,WU Bai-Feng

DOI: https://doi.org/10.3969/j.issn.1003-3254.2010.05.027

2010-01-01

Abstract:Sparse Matrix-vector multiplication(SpMV) is one of the most frequently used kernels in engineering practice and scientific computing.With the growth of the scale matrix,a large number of calculations restrict the performance of system,so SpMV can be accelerated by utilizing the high computing power of GPU.In this paper,the problem of existing SpMV on GPU is analyzed.Besides,row partition optimization and float4 optimization are designed.Experimental results demonstrate that the proposed approach can enhance the performance by 2-8 times.
Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Jianhua Gao,Weixing Ji,Yizhuo Wang

DOI: https://doi.org/10.1145/3676847

IF: 1.444

2024-01-01

ACM Transactions on Architecture and Code Optimization

Abstract:Sparse matrix-vector multiplication (SpMV) is one of the important kernels of many iterative algorithms for solving sparse linear systems. The limited storage and computational resources of individual GPUs restrict both the scale and speed of SpMV computing in problem-solving. As real-world engineering problems continue to increase in complexity, the imperative for collaborative execution of iterative solving algorithms across multiple GPUs is increasingly apparent. Although the multi-GPU-based SpMV takes less kernel execution time, it also introduces additional data transmission overhead, which diminishes the performance gains derived from parallelization across multi-GPUs. Based on the non-zero elements distribution characteristics of sparse matrices and the trade-off between redundant computations and data transfer overhead, this paper introduces a series of SpMV optimization techniques tailored for multi-GPU environments and effectively enhances the execution efficiency of iterative algorithms on multiple GPUs. Firstly, we propose a two-level non-zero elements-based matrix partitioning method to increase the overlap of kernel execution and data transmission. Then, considering the irregular non-zero elements distribution in sparse matrices, a long-row-aware matrix partitioning method is proposed to hide more data transmissions. Finally, an optimization using redundant and inexpensive short-row execution to exchange costly data transmission is proposed. Our experimental evaluation demonstrates that, compared with the SpMV on a single GPU, the proposed method achieves an average speedup of 2.00x and 1.85x on platforms equipped with two RTX 3090 and two Tesla V100-SXM2, respectively. The average speedup of 2.65x is achieved on a platform equipped with four Tesla V100-SXM2.
Iterative Sparse Matrix-Vector Multiplication On In-Memory Cluster Computing Accelerated By Gpus For Big Data

Jiwu Peng,Zheng Xiao,Cen Chen,Wangdong Yang

DOI: https://doi.org/10.1109/FSKD.2016.7603391

2016-01-01

Abstract:Iterative SpMV (ISpMV) is a key operation in many graph-based data mining algorithms and machine learning algorithms. Along with the development of big data, the matrices can be so large, perhaps billion-scale, that the SpMV can not be implemented in a single computer. Therefore, it is a challenging issue to implement and optimize SpMV for large-scale data sets. In this paper, we used an in-memory heterogeneous CPU-GPU cluster computing platforms (IMHCPs) to efficiently solve billion-scale SpMV problem. A dedicated and efficient hierarchy partitioning strategy for sparse matrices and the vector is proposed. The partitioning strategy contains partitioning sparse matrices among workers in the cluster and among GPUs in one worker. More, the performance of the IMHCPs-based SpMV is evaluated from the aspects of computation efficiency and scalability.
Efficient Sparse-Dense Matrix-Matrix Multiplication on GPUs Using the Customized Sparse Storage Format

Shaohuai Shi,Qiang Wang,Xiaowen Chu

DOI: https://doi.org/10.1109/icpads51040.2020.00013

2020-01-01

Abstract:Multiplication of a sparse matrix to a dense matrix (SpDM) is widely used in many areas like scientific computing and machine learning. However, existing work under-looks the performance optimization of SpDM on modern manycore architectures like GPUs. The storage data structures help sparse matrices store in a memory-saving format, but they bring difficulties in optimizing the performance of SpDM on modern GPUs due to irregular data access of the sparse structure, which results in lower resource utilization and poorer performance. In this paper, we refer to the roofline performance model of GPUs to design an efficient SpDM algorithm called GCOOSpDM, in which we exploit coalescent global memory access, fast shared memory reuse, and more operations per byte of global memory traffic. Experiments are evaluated on three Nvidia GPUs (i.e., GTX 980, GTX Titan X Pascal, and Tesla P100) using a large number of matrices including a public dataset and randomly generated matrices. Experimental results show that GCOOSpDM achieves 1.5-8x speedup over Nvidia's library cuSPARSE in many matrices.
DBCSR: A Library for Dense Matrix Multiplications on Distributed GPU-Accelerated Systems

Ilia Sivkov,Alfio Lazzaro,Juerg Hutter

DOI: https://doi.org/10.48550/arXiv.1910.04796

2019-10-11

Abstract:Most, if not all the modern scientific simulation packages utilize matrix algebra operations. Among the operation of the linear algebra, one of the most important kernels is the multiplication of matrices, dense and sparse. Examples of application of such a kernel are in electronic structure calculations, machine learning, data mining, graph processing, and digital signal processing. Several optimized libraries exist that can achieve high-performance on distributed systems. Only a few of them target distributed GPU-accelerated systems. In most of the cases, these libraries are provided and optimized by system vendors for their specific computer systems. In this paper, we present the DBCSR library (Distributed Block Compressed Sparse Row) for the distributed dense matrix-matrix multiplications. Although the library is specifically designed for block-sparse matrix-matrix multiplications, we optimized it for the dense case on GPU-accelerated systems. We show that the DBCSR outperforms the multiplication of matrices of different sizes and shapes provided by a vendor optimized GPU version of the ScaLAPACK library up to 2.5x (1.4x on average).

Distributed, Parallel, and Cluster Computing,Mathematical Software
TileSpMV: A Tiled Algorithm for Sparse Matrix-Vector Multiplication on GPUs

Yuyao Niu,Zhengyang Lu,Meichen Dong,Zhou Jin,Weifeng Liu,Guangming Tan

DOI: https://doi.org/10.1109/IPDPS49936.2021.00016

2021-01-01

Abstract:With the extensive use of GPUs in modern supercomputers, accelerating sparse matrix-vector multiplication (SpMV) on GPUs received much attention in the last couple of decades. A number of techniques. such as increasing utilization of wide vector units, reducing load imbalance and selecting the best formats, have been developed. However, the 2D spatial sparsity structure has not been well exploited in the existing work for SpMV on GPUs. In this paper, we propose an efficient tiled algorithm called TileSpMV for optimizing SpMV on GPUs through exploiting 2D spatial structure of sparse matrices. We first implement seven warp-level SpMV methods for calculating sparse tiles stored in a variety of formats, and then design a selection method to find the best format and SpMV implementation for each tile. We also adaptively extract nonzeros in the very sparse tiles into a separate matrix to maximize the overall performance. The experimental results show that our method is faster than state-of-the-art SpMV methods such as Merge-SpMV, CSR5 and BSR in most matrices of the full SuiteSparse Matrix Collection and delivers up to 2.61x, 3.96x and 426.59x speedups, respectively.
AMF-CSR: Adaptive Multi-Row Folding of CSR for SpMV on GPU.

Jianhua Gao,Weixing Ji,Jie Liu,Senhao Shao,Yizhuo Wang,Feng Shi

DOI: https://doi.org/10.1109/icpads53394.2021.00058

2021-01-01

Abstract:SpMV is a cost-dominant operation used in many iterative methods for solving large-scale sparse linear systems. However, irregular memory access of SpMV to the multiplied vector leads to low data locality and then harms the performance. This paper presents an adaptive multi-row folding of CSR (AMF-CSR) format for SpMV calculation on GPU. This new storage format supports the folding of the variable number of rows in order to achieve better load balancing in computation. AMF-CSR not only increases the density of non-zero elements in a folded row, thereby improving the access locality of the multiplied vector, but also merges an approximately equal number of nonzero elements in a folded row, hence achieving load balancing. The performance evaluation using 28 sparse matrices shows that the proposed SpMV algorithm based on AMF-CSR achieves the highest speedup of 4.11x and 3.62x on GTX 1080 Ti and Tesla V100 respectively against a fixed multi-row folding-based SpMV algorithm. Evaluation results using 450 regular sparse matrices and 450 irregular sparse matrices also show that AMF-CSR is superior to other SpMV implementations.

Adaptive diagonal sparse matrix-vector multiplication on GPU

Yet Another Hybrid Strategy for Auto-tuning SpMV on GPUs

TaiChi: A Hybrid Compression Format for Binary Sparse Matrix-Vector Multiplication on GPU

Accelerating Sparse Matrix Vector Multiplication on Many-Core GPUs

Implementing Sparse Matrix-Vector Multiplication Using CUDA Based on a Hybrid Sparse Matrix Format

Optimizing sparse matrix-vector multiplication based on gpu

Optimization of Sparse Matrix-Vector Multiplication with Variant CSR on GPUs

Diagonally-Addressed Matrix Nicknack: How to improve SpMV performance

Adaptive Row-grouped CSR Format for Storing of Sparse Matrices on GPU

Block-wise dynamic mixed-precision for sparse matrix-vector multiplication on GPUs

VBSF: a new storage format for SIMD sparse matrix–vector multiplication on modern processors

Parallel optimization for sparse matrix-vector on GPU

Efficient Algorithm Design of Optimizing SpMV on GPU.

A Segment‐based Sparse Matrix–vector Multiplication on CUDA

Improvement of Sparse Matrix-Vector Multiplication on GPU

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Iterative Sparse Matrix-Vector Multiplication On In-Memory Cluster Computing Accelerated By Gpus For Big Data

Efficient Sparse-Dense Matrix-Matrix Multiplication on GPUs Using the Customized Sparse Storage Format

DBCSR: A Library for Dense Matrix Multiplications on Distributed GPU-Accelerated Systems

TileSpMV: A Tiled Algorithm for Sparse Matrix-Vector Multiplication on GPUs

AMF-CSR: Adaptive Multi-Row Folding of CSR for SpMV on GPU.