Abstract:Recent boost of deep learning has revolutionized many machine learning tasks, including the graph neural networks (GNNs) that are specifically designed for non-Euclidean graph data. GNNs have been widely adopted in numerous real-world applications, such as the recommendation system. However, with increasingly enlarged graph size and complexity, GNN performance on conventional computers has been severely hindered by the memory bottleneck. The challenge attracts wide investigations, and the processing-in-memory (PIM) architecture arises as one of the most promising solutions. Prior works have leveraged the ReRAM crossbars as analog dot-product engines to accelerate the vector-matrix multiplications in GNN, and achieve prominent performance improvements over modern CPUs and GPUs. Nevertheless, analog computing is known to be variation-vulnerable, which hampers the inference accuracy of GNN. Besides, the mixed-signal peripherals (e.g., ADC) are hardware-expensive and specialize in dense computations, which makes the analog crossbar-based PIM not the ideal candidate for GNN inference whose computation is of great sparsity. In this work, we propose a novel digital-PIM architecture for GNN acceleration, namely GIM. Our compact yet efficient digital computing paradigm can greatly boost computing parallelism with a minimum budget. GIM integrates dedicated optimizations on both operand- and bit-sparsity, to eliminate sparse computations thus significantly boost the performance. Meanwhile, at the software level, we implement data-layout optimizations to minimize the inter-memory communications and maximize computing parallelism. Our design derives prominent performance improvements over the modern CPU, GPU, and state-of-the-art PIM-based accelerators. Compared to modern CPU and GPU, GIM averagely achieves 24485x and 778x of speedup, and 78480x and 8906x of energy reduction. Compared to the state-of-the-art PIM-based GNN accelerators ReFlip and PIMGCN, GIM averagely achieves 9.0x and 73.4x of throughput boost with 15.2x and 95.6x of efficiency improvements.

Gibbon: Efficient Co-Exploration of NN Model and Processing-In-Memory Architecture

A design framework for processing-in-memory accelerator

Accelerating Neural Network Inference with Processing-in-DRAM: From the Edge to the Cloud

PIMulator-NN: an Event-Driven, Cross-level Simulation Framework for Processing-In-Memory Based Neural Network Accelerators

MNSIM-TIME: Performance Modeling Framework for Training-In-Memory Architectures

Reliability-Aware Training and Performance Modeling for Processing-In-Memory Systems

GIM: Versatile GNN Acceleration with Reconfigurable Processing-in-Memory

MNSIM 2.0: A Behavior-Level Modeling Tool for Processing-In-Memory Architectures.

Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators

A 3.89-Gops/mw Scalable Recurrent Neural Network Processor with Improved Efficiency on Memory and Computation

Accelerating Neural Network Training with Processing-in-Memory GPU

NicePIM: Design Space Exploration for Processing-In-Memory DNN Accelerators with 3D-Stacked-DRAM

PIMGCN: A ReRAM-Based PIM Design for Graph Convolutional Network Acceleration

MNSIM 2.0: A Behavior-Level Modeling Tool for Memristor-based Neuromorphic Computing Systems

Neural-PIM: Efficient Processing-In-Memory with Neural Approximation of Peripherals

Generalized Ping-Pong: Off-Chip Memory Bandwidth Centric Pipelining Strategy for Processing-In-Memory Accelerators

G-NMP: Accelerating Graph Neural Networks with DIMM-based Near-Memory Processing

PASGCN: An ReRAM-Based PIM Design for GCN With Adaptively Sparsified Graphs

Exploiting Parallelism with Vertex-Clustering in Processing-In-Memory-based GCN Accelerators

PyGim: An Efficient Graph Neural Network Library for Real Processing-In-Memory Architectures