Abstract:Sparse matrix-vector multiplication (SpMV) is an important primitive across a wide range of application domains such as scientific computing and graph analytics. Due to its intrinsic memory-bound characteristics, the performance of SpMV on throughput-oriented architectures such as GPU is bounded by the limited bandwidth between processors and memory. Processing-in-memory (PIM) architectures, made feasible by advances in 3D stacking, provide new opportunities to utilize ultra-high bandwidth by integrating compute-logic into memory. In this paper, we develop an SpMV accelerator, named as SpaceA, based on PIM architectures. SpaceA integrates compute-logic near memory banks to exploit bank-level bandwidth. SpaceA contains both hardware and data-mapping design features to alleviate irregular memory access patterns which hinder full utilization of high memory bandwidth. In terms of hardware design features, SpaceA consists of two unique features: (1) it utilizes the capability of outstanding memory requests to hide the memory access latency to data located in non-local memory banks; (2) it integrates Content Addressable Memory (CAM) at the bank level to exploit data reuse of the input vectors. In addition, we develop a mapping scheme that partitions the sparse matrix into different memory banks, to maximize the data locality of the input vector and to achieve workload balance among processing elements (PEs) near each bank. Overall, SpaceA together with the proposed mapping method achieves 13.54x speedup and 87.49% energy saving on average over the GPU baseline on SpMV computation. In addition to SpMV primitives, we conduct a case study on graph analytics to demonstrate the benefits of SpaceA for applications built on SpMV. Compared to Tesseract and GraphP, state-of-the-art graph accelerators, SpaceA obtains better performance due to its higher effective bandwidth provided by near-bank integration.

GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication

SpaceA: Sparse Matrix Vector Multiplication on Processing-in-Memory Accelerator

A sparse matrix vector multiplication accelerator based on high-bandwidth memory

SpArch: Efficient Architecture for Sparse Matrix Multiplication

Iterative Sparse Matrix-Vector Multiplication On In-Memory Cluster Computing Accelerated By Gpus For Big Data

Accelerating Unstructured SpGEMM using Structured In-situ Computing

Spada: Accelerating Sparse Matrix Multiplication with Adaptive Dataflow.

Esspmv: an Embedded-FPGA-based Hardware Accelerator for Symmetric Sparse Matrix-Vector Multiplication.

Accelerating Sparse Approximate Matrix Multiplication on GPUs

SPCIM: Sparsity-Balanced Practical CIM Accelerator with Optimized Spatial-Temporal Multi-Macro Utilization

Accelerating approximate matrix multiplication for near-sparse matrices on GPUs

Register-Aware Optimizations for Parallel Sparse Matrix–Matrix Multiplication

Dedicated Hardware Accelerators for Processing of Sparse Matrices and Vectors: A Survey

Multi-GPU Implementation and Performance Optimization for CSR-Based Sparse Matrix-Vector Multiplication

Efficient FPGA-Based Sparse Matrix–Vector Multiplication with Data Reuse-Aware Compression

Mentha: Enabling Sparse-Packing Computation on Systolic Arrays.

FSpGEMM: An OpenCL-based HPC Framework for Accelerating General Sparse Matrix-Matrix Multiplication on FPGAs

Balanced Data Placement for GEMV Acceleration with Processing-In-Memory

ApSpGEMM: Accelerating Large-scale SpGEMM with Heterogeneous Collaboration and Adaptive Panel

Serpens: A High Bandwidth Memory Based Accelerator for General-Purpose Sparse Matrix-Vector Multiplication