Abstract:Dynamic Graph Neural Network (DGNN) has recently attracted a significant amount of research attention from various domains, because most real-world graphs are inherently dynamic. Despite many research efforts, for DGNN, existing hardware/software solutions still suffer significantly from redundant computation and memory access overhead, because they need to irregularly access and recompute all graph data of each graph snapshot. To address these issues, we propose an efficient redundancy-aware accelerator, RACE , which enables energy-efficient execution of DGNN models. Specifically, we propose a redundancy-aware incremental execution approach into the accelerator design for DGNN to instantly achieve the output features of the latest graph snapshot by correctly and incrementally refining the output features of the previous graph snapshot and also enable regular accesses of vertices’ input features. Through traversing the graph on the fly, RACE identifies the vertices that are not affected by graph updates between successive snapshots to reuse these vertices’ states (i.e., their output features) of the previous snapshot for the processing of the latest snapshot. The vertices affected by graph updates are also tracked to incrementally recompute their new states using their neighbors’ input features of the latest snapshot for correctness. In this way, the processing and accessing of many graph data that are not affected by graph updates can be correctly eliminated, enabling smaller redundant computation and memory access overhead. Besides, the input features, which are accessed more frequently, are dynamically identified according to graph topology and are preferentially resident in the on-chip memory for less off-chip communications. Experimental results show that RACE achieves on average 1139× and 84.7× speedups for DGNN inference, with average 2242× and 234.2× energy savings, in comparison with the state-of-the-art software DGNN running on Intel Xeon CPU and NVIDIA A100 GPU, respectively. Moreover, for DGNN inference, RACE obtains on average 13.1×, 11.7×, 10.4×, and 7.9× speedup and 14.8×, 12.9×, 11.5×, and 8.9× energy savings over the state-of-the-art Graph Neural Network accelerators, i.e., AWB-GCN, GCNAX, ReGNN, and I-GCN, respectively.

DRAGON: Dynamic Recurrent Accelerator for Graph Online Convolution

DRGN: a dynamically reconfigurable accelerator for graph neural networks

DyGA: A Hardware-Efficient Accelerator with Traffic-Aware Dynamic Scheduling for Graph Convolutional Networks.

EnGN: A High-Throughput and Energy-Efficient Accelerator for Large Graph Neural Networks

Woodpecker-DL: Accelerating Deep Neural Networks via Hardware-Aware Multifaceted Optimizations

DeltaGNN: Accelerating Graph Neural Networks on Dynamic Graphs with Delta Updating

GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design

RACE: an Efficient Redundancy-aware Accelerator for Dynamic Graph Neural Network.

CoGNN: An Algorithm-Hardware Co-Design Approach to Accelerate GNN Inference With Minibatch Sampling

DGNN-Booster: A Generic FPGA Accelerator Framework For Dynamic Graph Neural Network Inference

ReaDy: A ReRAM-Based Processing-in-Memory Accelerator for Dynamic Graph Convolutional Networks.

DRAGON (Differentiable Graph Execution) : A suite of Hardware Simulation and Optimization tools for Modern AI/Non-AI Workloads

DepGraph: A Dependency-Driven Accelerator for Efficient Iterative Graph Processing

TuNao: A High-Performance and Energy-Efficient Reconfigurable Accelerator for Graph Processing

Accelerating Graph Convolutional Networks Using Crossbar-based Processing-In-Memory Architectures

ACE-GCN: A Fast Data-driven FPGA Accelerator for GCN Embedding

Bottleneck Analysis of Dynamic Graph Neural Network Inference on CPU and GPU

GDR-HGNN: A Heterogeneous Graph Neural Networks Accelerator Frontend with Graph Decoupling and Recoupling

PCGCN: Partition-Centric Processing for Accelerating Graph Convolutional Network

Grapher: A Reconfigurable Graph Computing Accelerator with Optimized Processing Elements

TDGraph