Abstract:In recent years, graph neural networks (GNNs) have achieved impressive performance in various application fields by extracting information from graph-structured data. It contains extensive feature aggregation operations and has become a performance bottleneck, which can be abstracted as a specialized sparse-dense matrix multiplication (SpMM) operation. Previous works have leveraged the inner product or outer product to accelerate the feature aggregation process. However, inefficient execution leads to extremely unbalanced workloads and extensive intermediate data, hampering the performance of previous processors. So in this article, we demonstrate an algorithm/hardware co-optimization chance to enhance SpMM acceleration for GNNs. First, the algorithm part develops a dataflow-efficient SpMM algorithm that integrates three optimization methods to mitigate computation and memory access inefficiencies. Specifically, 1) the proposed equal-value partition method achieves fine-grained data partition and enables load balancing during data movement; 2) after observing the vertex aggregation phenomenon, a vertex-clustering optimization method is presented to enable significant data locality; and 3) the adaptive dataflow based on Gustavson’s algorithm is further implemented to enable the efficient distribution of sparse elements and improves computing resource utilization. Then, the hardware part features the proposed SpMM algorithm and customizes SDMA, a flexible and efficient accelerator to boost SpMM acceleration, which follows the adaptive dataflow to eliminate sparsity and explore the regular parallelism dimension. Finally, we prototype SDMA on the Xilinx Alveo U280 FPGA accelerator card. The results demonstrate that SDMA achieves $5.68\times $ – $14.68\times $ energy efficiency over the previous GPU implementations deployed on the Nvidia GTX 1080Ti and $1.32\times $ higher throughput over the state-of-the-art FPGA prototype.

SVR: A Shard-aware Vertex Reordering Method for Efficient GNN Execution and Memory Access

SCV-GNN: Sparse Compressed Vector-based Graph Neural Network Aggregation

Cached Operator Reordering: A Unified View for Fast GNN Training

FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training

VersaGNN: a Versatile accelerator for Graph neural networks

Algorithm/Hardware Co-Optimization for Sparsity-Aware SpMM Acceleration of GNNs

MEGA: A Memory-Efficient GNN Accelerator Exploiting Degree-Aware Mixed-Precision Quantization

An Efficient GCN Accelerator Based on Workload Reorganization and Feature Reduction

Understanding GNN Computational Graph: A Coordinated Computation, IO, and Memory Perspective

The Card Shuffling Hypotheses: Building a Time and Memory Efficient Graph Convolutional Network

SpanGNN: Towards Memory-Efficient Graph Neural Networks via Spanning Subgraph Training

PartitionedVC: Partitioned External Memory Graph Analytics Framework for SSDs

Towards Efficient Large-Scale Graph Neural Network Computing.

GATe: Streamlining Memory Access and Communication to Accelerate Graph Attention Network With Near-Memory Processing

Sparse Decomposition of Graph Neural Networks

EnGN: A High-Throughput and Energy-Efficient Accelerator for Large Graph Neural Networks

NDPGNN: A Near-Data Processing Architecture for GNN Training and Inference Acceleration

GDR-HGNN: A Heterogeneous Graph Neural Networks Accelerator Frontend with Graph Decoupling and Recoupling

Efficient GCN Deployment with Spiking Property on Spatial-Temporal Neuromorphic Chips.

GNNear: Accelerating Full-Batch Training of Graph Neural Networks with Near-Memory Processing

STAG: Enabling Low Latency and Low Staleness of GNN-based Services with Dynamic Graphs