Abstract:Recently, Graph Convolutional Networks (GCNs) have shown powerful learning capabilities in graph processing tasks. Computing GCNs with conventional von Neumann architectures usually suffers from limited memory bandwidth due to the irregular memory access. Recent work has proposed Processing-In-Memory (PIM) architectures to overcome the bandwidth bottleneck in Convolutional Neural Networks (CNNs) by performing in-situ matrix-vector multiplication. However, the performance improvement and computation parallelism of existing CNN-oriented PIM architectures is hindered when performing GCNs because of the large scale and sparsity of graphs. To tackle these problems, this paper presents a parallelism enhancement framework for PIM-based GCN architectures. At the software level, we propose a fixed-point quantization method for GCNs, which reduces the PIM computation overhead with little accuracy loss. We also introduce the vertex clustering algorithm to the graph, minimizing the inter-cluster links and realizing cluster-level parallel computing on multi-core systems. At the hardware level, we design a Resistive Random Access Memory (RRAM) based multi-core PIM architecture for GCN, which supports the cluster-level parallelism. Besides, we propose a coarse-grained pipeline dataflow to cover the RRAM write costs and improve the GCN computation throughput. At the software/hardware interface level, we propose a PIM-aware GCN mapping strategy to achieve the optimal tradeoff between resource utilization and computation performance. We also propose edge dropping methods to reduce the inter-core communications with little accuracy loss. We evaluate our framework on typical datasets with multiple widely-used GCN models. Experimental results show that the proposed framework achieves $698\times, 89\times$ , and $41\times$ speedup with $7108\times,255\times$ , and $31\times$ energy efficiency enhancement compared with CPUs, GPUs, and ASICs, respectively.

TensorCache: Reconstructing Memory Architecture with SRAM-Based In-Cache Computing for Efficient Tensor Computations in GPGPUs

A design framework for processing-in-memory accelerator

Advanced hybrid MRAM based novel GPU cache system for graphic processing with high efficiency

VSPIM: SRAM Processing-in-Memory DNN Acceleration via Vector-Scalar Operations

Atomic Cache: Enabling Efficient Fine-Grained Synchronization with Relaxed Memory Consistency on GPGPUs Through In-Cache Atomic Operations

PIMGCN: A ReRAM-Based PIM Design for Graph Convolutional Network Acceleration

Cache-emulated Register File: an Integrated On-Chip Memory Architecture for High Performance GPGPUs

RISC-V based Fully-Parallel SRAM Computing-in-Memory Accelerator with High Hardware Utilization and Data Reuse Rate

Neural Cache: Bit-Serial In-Cache Acceleration of Deep Neural Networks.

PIMSAB: A Processing-In-Memory System with Spatially-Aware Communication and Bit-Serial-Aware Computation

PASGCN: An ReRAM-Based PIM Design for GCN With Adaptively Sparsified Graphs

Optimizing Non-Coalesced Memory Access for Irregular Applications with GPU Computing

Re-Cache: Mitigating Cache Contention by Exploiting Locality Characteristics with Reconfigurable Memory Hierarchy for GPGPUs.

Exploiting Parallelism with Vertex-Clustering in Processing-In-Memory-based GCN Accelerators

14.2 A Compute SRAM with Bit-Serial Integer/Floating-Point Operations for Programmable In-Memory Vector Acceleration

NAND-SPIN-based processing-in-MRAM architecture for convolutional neural network acceleration

G10: Enabling An Efficient Unified GPU Memory and Storage Architecture with Smart Tensor Migrations

Adaptive Cache Management for Energy-Efficient GPU Computing.

GPU Accelerating for Rapid Multi-core Cache Simulation

An RRAM-Based Computing-in-Memory Architecture and Its Application in Accelerating Transformer Inference

Shared Last-Level Cache Management for GPGPUs with Hybrid Main Memory