Abstract:Recent boost of deep learning has revolutionized many machine learning tasks, including the graph neural networks (GNNs) that are specifically designed for non-Euclidean graph data. GNNs have been widely adopted in numerous real-world applications, such as the recommendation system. However, with increasingly enlarged graph size and complexity, GNN performance on conventional computers has been severely hindered by the memory bottleneck. The challenge attracts wide investigations, and the processing-in-memory (PIM) architecture arises as one of the most promising solutions. Prior works have leveraged the ReRAM crossbars as analog dot-product engines to accelerate the vector-matrix multiplications in GNN, and achieve prominent performance improvements over modern CPUs and GPUs. Nevertheless, analog computing is known to be variation-vulnerable, which hampers the inference accuracy of GNN. Besides, the mixed-signal peripherals (e.g., ADC) are hardware-expensive and specialize in dense computations, which makes the analog crossbar-based PIM not the ideal candidate for GNN inference whose computation is of great sparsity. In this work, we propose a novel digital-PIM architecture for GNN acceleration, namely GIM. Our compact yet efficient digital computing paradigm can greatly boost computing parallelism with a minimum budget. GIM integrates dedicated optimizations on both operand- and bit-sparsity, to eliminate sparse computations thus significantly boost the performance. Meanwhile, at the software level, we implement data-layout optimizations to minimize the inter-memory communications and maximize computing parallelism. Our design derives prominent performance improvements over the modern CPU, GPU, and state-of-the-art PIM-based accelerators. Compared to modern CPU and GPU, GIM averagely achieves 24485x and 778x of speedup, and 78480x and 8906x of energy reduction. Compared to the state-of-the-art PIM-based GNN accelerators ReFlip and PIMGCN, GIM averagely achieves 9.0x and 73.4x of throughput boost with 15.2x and 95.6x of efficiency improvements.

DCIM-GCN: Digital Computing-in-Memory Accelerator for Graph Convolutional Network

PIMGCN: A ReRAM-Based PIM Design for Graph Convolutional Network Acceleration

TensorCIM: Digital Computing-in-Memory Tensor Processor with Multichip-Module-Based Architecture for Beyond-NN Acceleration

Accelerating Graph Convolutional Networks Through a PIM-Accelerated Approach

An Efficient GCNs Accelerator Using 3D-Stacked Processing-In-Memory Architectures

Fe-GCN: A 3D FeFET Memory Based PIM Accelerator for Graph Convolutional Networks

PASGCN: An ReRAM-Based PIM Design for GCN With Adaptively Sparsified Graphs

Fully Binarized Graph Convolutional Network Accelerator Based on In‐Memory Computing with Resistive Random‐Access Memory

Towards efficient allocation of graph convolutional networks on hybrid computation-in-memory architecture

GIM: Versatile GNN Acceleration with Reconfigurable Processing-in-Memory

A CIM-Digital Heterogeneous Accelerating System with Analog Interconnection for Neural Networks

IMGA: Efficient In-Memory Graph Convolution Network Aggregation with Data Flow Optimizations

Cambricon-M: A Fibonacci-Coded Charge-Domain SRAM-Based CIM Accelerator for DNN Inference

TensorCIM: A 28nm 3.7nJ/Gather and 8.3TFLOPS/W FP32 Digital-CIM Tensor Processor for MCM-CIM-Based Beyond-NN Acceleration.

An Energy-Efficient In-Memory Accelerator for Graph Construction and Updating

DyGA: A Hardware-Efficient Accelerator with Traffic-Aware Dynamic Scheduling for Graph Convolutional Networks.

Exploiting Parallelism with Vertex-Clustering in Processing-In-Memory-based GCN Accelerators

A Digital SRAM Computing-in-Memory Design Utilizing Activation Unstructured Sparsity for High-Efficient DNN Inference

16.4 TensorCIM: A 28nm 3.7nj/gather and 8.3TFLOPS/W FP32 Digital-CIM Tensor Processor for MCM-CIM-Based Beyond-NN Acceleration

34.3 A 22nm 64kb Lightning-Like Hybrid Computing-in-Memory Macro with a Compressed Adder Tree and Analog-Storage Quantizers for Transformer and CNNs.

Accel-GCN: High-Performance GPU Accelerator Design for Graph Convolution Networks