Abstract:Sparse matrix-vector multiplication (SpMV) is an important primitive across a wide range of application domains such as scientific computing and graph analytics. Due to its intrinsic memory-bound characteristics, the performance of SpMV on throughput-oriented architectures such as GPU is bounded by the limited bandwidth between processors and memory. Processing-in-memory (PIM) architectures, made feasible by advances in 3D stacking, provide new opportunities to utilize ultra-high bandwidth by integrating compute-logic into memory. In this paper, we develop an SpMV accelerator, named as SpaceA, based on PIM architectures. SpaceA integrates compute-logic near memory banks to exploit bank-level bandwidth. SpaceA contains both hardware and data-mapping design features to alleviate irregular memory access patterns which hinder full utilization of high memory bandwidth. In terms of hardware design features, SpaceA consists of two unique features: (1) it utilizes the capability of outstanding memory requests to hide the memory access latency to data located in non-local memory banks; (2) it integrates Content Addressable Memory (CAM) at the bank level to exploit data reuse of the input vectors. In addition, we develop a mapping scheme that partitions the sparse matrix into different memory banks, to maximize the data locality of the input vector and to achieve workload balance among processing elements (PEs) near each bank. Overall, SpaceA together with the proposed mapping method achieves 13.54x speedup and 87.49% energy saving on average over the GPU baseline on SpMV computation. In addition to SpMV primitives, we conduct a case study on graph analytics to demonstrate the benefits of SpaceA for applications built on SpMV. Compared to Tesseract and GraphP, state-of-the-art graph accelerators, SpaceA obtains better performance due to its higher effective bandwidth provided by near-bank integration.

Reduction of space complexity based on symmetric TMVP

Low complexity bit parallel multiplier for GF(2m) generated by equally-spaced trinomials

Efficient bit-parallel multiplier for finite field of trinomial using SPB and its weakly dual basis.

Atomic Reduction Based Sparse Matrix-Transpose Vector Multiplication on GPUs

Design and implementation of pipelined TMVP multiplier using block recombination

$\Schmi{gf(2^n)}$ Shifted Polynomial Basis Multipliers Based on Subquadratic Toeplitz Matrix-Vector Product Approach for All Irreducible Pentanomials

TaiChi: A Hybrid Compression Format for Binary Sparse Matrix-Vector Multiplication on GPU

Towards Low Space Complexity Design of Gaussian Normal Basis Multiplication

A New Approach to Subquadratic Space Complexity Parallel Multipliers for Extended Binary Fields

A fast NTRU software implementation based on 5-way TMVP

Fast algorithms for the solution of perturbed symmetric Toeplitz linear system and its applications

A Novel Parallel Algorithm for Sparse Tensor Matrix Chain Multiplication via TCU-Acceleration

Toward Greener Matrix Operations by Lossless Compressed Formats

Gf(2(N)) Redundant Representation Using Matrix Embedding for Irreducible Trinomials

Virtual Transmission Method, A New Distributed Algorithm to Solve Sparse Linear System

An Integral-equation-oriented Vectorized SpMV Algorithm and Its Application on CT Imaging Reconstruction

Approximate Multiplication of Sparse Matrices with Limited Space

Efficient Model Reduction of Interconnects Via Double Gramians Approximation.

SpaceA: Sparse Matrix Vector Multiplication on Processing-in-Memory Accelerator

Reducing the Symmetric Matrix Eigenvalue Problem to Matrix Multiplications

Sparse Matrix-Vector Multiplication Optimizations based on Matrix Bandwidth Reduction using NVIDIA CUDA