Abstract:Dynamic Graph Neural Network (DGNN) has recently attracted a significant amount of research attention from various domains, because most real-world graphs are inherently dynamic. Despite many research efforts, for DGNN, existing hardware/software solutions still suffer significantly from redundant computation and memory access overhead, because they need to irregularly access and recompute all graph data of each graph snapshot. To address these issues, we propose an efficient redundancy-aware accelerator, RACE , which enables energy-efficient execution of DGNN models. Specifically, we propose a redundancy-aware incremental execution approach into the accelerator design for DGNN to instantly achieve the output features of the latest graph snapshot by correctly and incrementally refining the output features of the previous graph snapshot and also enable regular accesses of vertices’ input features. Through traversing the graph on the fly, RACE identifies the vertices that are not affected by graph updates between successive snapshots to reuse these vertices’ states (i.e., their output features) of the previous snapshot for the processing of the latest snapshot. The vertices affected by graph updates are also tracked to incrementally recompute their new states using their neighbors’ input features of the latest snapshot for correctness. In this way, the processing and accessing of many graph data that are not affected by graph updates can be correctly eliminated, enabling smaller redundant computation and memory access overhead. Besides, the input features, which are accessed more frequently, are dynamically identified according to graph topology and are preferentially resident in the on-chip memory for less off-chip communications. Experimental results show that RACE achieves on average 1139× and 84.7× speedups for DGNN inference, with average 2242× and 234.2× energy savings, in comparison with the state-of-the-art software DGNN running on Intel Xeon CPU and NVIDIA A100 GPU, respectively. Moreover, for DGNN inference, RACE obtains on average 13.1×, 11.7×, 10.4×, and 7.9× speedup and 14.8×, 12.9×, 11.5×, and 8.9× energy savings over the state-of-the-art Graph Neural Network accelerators, i.e., AWB-GCN, GCNAX, ReGNN, and I-GCN, respectively.

DyGA: A Hardware-Efficient Accelerator with Traffic-Aware Dynamic Scheduling for Graph Convolutional Networks.

SPA-GCN: Efficient and Flexible GCN Accelerator with an Application for Graph Similarity Computation

HyGCN: A GCN Accelerator with Hybrid Architecture

An Efficient GCN Accelerator Based on Workload Reorganization and Feature Reduction

Accel-GCN: High-Performance GPU Accelerator Design for Graph Convolution Networks

DRGN: a dynamically reconfigurable accelerator for graph neural networks

Software-hardware Co-Design for Accelerating Large-Scale Graph Convolutional Network Inference on FPGA

Vidgcn: Embracing Input Data Diversity with a Configurable Graph Convolutional Network Accelerator

GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design

ACE-GCN: A Fast Data-driven FPGA Accelerator for GCN Embedding

GDR-HGNN: A Heterogeneous Graph Neural Networks Accelerator Frontend with Graph Decoupling and Recoupling

LW-GCN: A Lightweight FPGA-based Graph Convolutional Network Accelerator

Towards a Deep-Pipelined Architecture for Accelerating Deep GCN on a Multi-FPGA Platform

AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing

PCGCN: Partition-Centric Processing for Accelerating Graph Convolutional Network

HuGraph: Acceleration of GCN Training on Heterogeneous FPGA Clusters with Quantization

DGNN-Booster: A Generic FPGA Accelerator Framework For Dynamic Graph Neural Network Inference

An FPGA Implementation of GCN with Sparse Adjacency Matrix

RACE: an Efficient Redundancy-aware Accelerator for Dynamic Graph Neural Network.

H-GCN: A Graph Convolutional Network Accelerator on Versal ACAP Architecture

EnGN: A High-Throughput and Energy-Efficient Accelerator for Large Graph Neural Networks