Abstract:General sparse matrix–matrix multiplication (SpGEMM) is integral to many high-performance computing (HPC) and machine learning applications. However, prior field-programmable gate array (FPGA)-based SpGEMM accelerators either use the inner product algorithm with wasted and costly operations or Gustavson’s algorithm with a cache-based hardware architecture suffering from long-latency cache miss penalties and limited to embedded devices. In this work, we propose framework for accelerating SpGEMM (FSpGEMM), an OpenCL-based SpGEMM framework for accelerating Gustvason’s algorithm that includes an FPGA kernel implementing a throughput-optimized and scalable hardware architecture compatible with high-bandwidth memory (HBM) or traditional DDR-based memory. In addition, to address the irregular memory access patterns incurred by Gustavson’s algorithm, we propose a new buffering scheme tailored to Gustavson’s algorithm enabled by a new compressed sparse vector (CSV) format for representing sparse matrices and a row reordering technique as a preprocessing step to improve data reuse, and consequently, resource utilization. The proposed framework includes a host program implementing preprocessing functions for reordering input matrices and storing them in the proposed CSV format for further use. We implemented FSpGEMM using Intel FPGA SDK for OpenCL and experimented with a benchmark of sparse matrices selected from the SuiteSparse Matrix Collection on a Bittware 520N-MX FPGA board. The results show that the reordering technique improves the performance on average by 20.3% compared with the baseline. Finally, FSpGEMM outperforms the state-of-the-art (SOTA) FPGA implementation by an average of $2.23\times $ in terms of execution cycles with the same benchmark and memory system configuration for a fair comparison.

Greedy approach based heuristics for partitioning SpMxV on FPGAs

Greedy Approach Based Heuristics for Partitioning Sparse Matrices

Sparse matrix partitioning for optimizing SpMV on CPU-GPU heterogeneous platforms

No Zero Padded Sparse Matrix-Vector Multiplication on FPGAs

An Optimized GP-GPU Warp Scheduling Algorithm for Sparse Matrix-Vector Multiplication

FPGA and GPU Implementation of Large Scale SpMV

Efficient Memory Partitioning for Parallel Data Access in FPGA via Data Reuse

Optimization of SpGEMM with Risc-V vector instructions

Esspmv: an Embedded-FPGA-based Hardware Accelerator for Symmetric Sparse Matrix-Vector Multiplication.

Efficient Memory Partitioning For Parallel Data Access Via Data Reuse

Near-Memory Parallel Indexing and Coalescing: Enabling Highly Efficient Indirect Access for SpMV

Exploring the Design Space of Distributed Parallel Sparse Matrix-Multiple Vector Multiplication

A sparse matrix vector multiplication accelerator based on high-bandwidth memory

Efficient Algorithm Design of Optimizing SpMV on GPU.

ReDESK: A Reconfigurable Dataflow Engine for Sparse Kernels on Heterogeneous Platforms.

Optimizing sparse matrix-vector multiplication based on gpu

TileSpMSpV: A Tiled Algorithm for Sparse Matrix-Sparse Vector Multiplication on GPUs

A Data Locality-Aware Design Framework For Reconfigurable Sparse Matrix-Vector Multiplication Kernel

Towards Efficient SpMV on Sunway Manycore Architectures.

FSpGEMM: A Framework for Accelerating Sparse General Matrix–Matrix Multiplication Using Gustavson’s Algorithm on FPGAs

Implementation and optimization of SpMV algorithm based on SW26010P many-core processor and stored in BCSR format