Abstract:Sparse matrix-vector multiplication (SpMV) is one of the important subroutines in numerical linear algebras widely used in lots of large-scale applications. Accelerating SpMV on multicore and manycore architectures based on Compressed Sparse Row (CSR) format via row-wise parallelization is one of the most popular directions. However, there are three main challenges in optimizing parallel CSR-based SpMV: (a) limited local memory of each computing unit can be overwhelmed by assignments to long rows of large-scale sparse matrices; (b) irregular accesses to the input vector result in expensive memory access latency; (c) sparse data structure leads to low bandwidth usage. This paper proposes a two-phase large-scale SpMV, called tpSpMV, based on the memory structure and computing architecture of multicore and manycore architectures to alleviate the three main difficulties. First, we propose the two-phase parallel execution technique for tpSpMV that performs parallel CSR-based SpMV into two separate phases to overcome the computational scale limitation. Second, we respectively propose the adaptive partitioning methods and parallelization designs using the local memory caching technique for the two phases to exploit the architectural advantages of the high-performance computing platforms and alleviate the problem of high memory access latency. Third, we design several optimizations, such as data reduction, aligned memory accessing, and pipeline technique, to improve bandwidth usage and optimize tpSpMV’s performance. Experimental results on SW26010 CPUs of the Sunway TaihuLight supercomputer prove that tpSpMV achieves up to 28.61 speedups and yields the performance improvement of 13.16% over the state-of-the-art work on average.

COSC: Combine Optimized Sparse Matrix-Vector Multiplication for CSR Format

Optimization of Sparse Matrix-Vector Multiplication with Variant CSR on GPUs

Multi-GPU Implementation and Performance Optimization for CSR-Based Sparse Matrix-Vector Multiplication

Efficient CSR-Based Sparse Matrix-Vector Multiplication on GPU

CSR2: A New Format for SIMD-accelerated SpMV.

A Simple and Efficient Storage Format for SIMD-accelerated SpMV

LSRB-CSR: A Low Overhead Storage Format for SpMV on the GPU Systems

Implementing Sparse Matrix-Vector Multiplication with Qcsr on Gpu

An Integral-equation-oriented Vectorized SpMV Algorithm and Its Application on CT Imaging Reconstruction

Optimizing sparse matrix-vector multiplication based on gpu

A Cross-Platform SpMV Framework on Many-Core Architectures.

Tpspmv: A Two-Phase Large-Scale Sparse Matrix-Vector Multiplication Kernel for Manycore Architectures

Efficient Algorithm Design of Optimizing SpMV on GPU.

B-Sct: Improve Spmv Processing On Simd Architectures

Implementation and optimization of SpMV algorithm based on SW26010P many-core processor and stored in BCSR format

AMF-CSR: Adaptive Multi-Row Folding of CSR for SpMV on GPU.

Performance Analysis and Optimization of Sparse Matrix-Vector Multiplication on Modern Multi- and Many-Core Processors

Yet Another Hybrid Strategy for Auto-tuning SpMV on GPUs

Performance analysis and optimization for SpMV based on aligned storage formats on an ARM processor

ALBUS: A Method for Efficiently Processing SpMV Using SIMD and Load Balancing

Efficient Sparse Matrix-Vector Multiplication Using Cache Oblivious Extension Quadtree Storage Format.