Abstract:Graph traversal is widely used in map routing, social network analysis, causal discovery and many more applications. Because it is a memory-bound process, graph traversal puts significant pressure on the memory subsystem. Due to poor spatial locality and the increasing size of today’s datasets, graph traversal consumes an ever-larger part of application execution time. One way to mitigate this cost is memory prefetching, which issues requests from the processor to the memory in anticipation of needing certain data. However, traditional prefetching does not work well for graph traversal due to data dependencies, the parallel nature of graphs and the need to move vast amounts of data from memory to the caches. In this paper, we propose a compressed sparse row representation-based graph accelerator on the Hybrid Memory Cube (HMC), called CGAcc. CGAcc combines Compressed Sparse Row (CSR) graph representation with in-memory prefetching and processing to improve the performance of graph traversal. Our approach integrates the prefetching and processing in the logic layer of a 3D stacked Dynamic Random-Access Memory (DRAM) architecture, based on Micron’s HMC. We selected HMC to implement CGAcc because it can provide quite high bandwidth and low access latency. Furthermore, this device has multiple DRAM layers connected to internal logic to control memory access and perform rudimentary computation. Using the CSR representation, CGAcc deploys prefetchers in the HMC to exploit the short transaction latency between the logic and DRAM layers. By doing this, it can also avoid large data movement costs. In the runtime, CGAcc pipelines the prefetching to fetch data from DRAM arrays to improve memory-level parallelism. To further reduce the access latency, several optimized internal caches are also introduced to hold the prefetched data to be Processed In-Memory (PIM). A comprehensive evaluation shows the effectiveness of CGAcc. Experimental results showed that, compared to a conventional HMC main memory equipped with a stream prefetcher, CGAcc achieved an average 3.51× speedup with moderate hardware cost.

An Energy-Efficient In-Memory Accelerator for Graph Construction and Updating

A design framework for processing-in-memory accelerator

An Efficient GCNs Accelerator Using 3D-Stacked Processing-In-Memory Architectures

IMGA: Efficient In-Memory Graph Convolution Network Aggregation with Data Flow Optimizations

DCIM-GCN: Digital Computing-in-Memory Accelerator for Graph Convolutional Network

Accelerating Graph Convolutional Networks Through a PIM-Accelerated Approach

An Efficient Graph Accelerator with Distributed On-Chip Memory Hierarchy.

Towards efficient allocation of graph convolutional networks on hybrid computation-in-memory architecture

Fe-GCN: A 3D FeFET Memory Based PIM Accelerator for Graph Convolutional Networks

DyGA: A Hardware-Efficient Accelerator with Traffic-Aware Dynamic Scheduling for Graph Convolutional Networks.

GraphIA: an In-Situ Accelerator for Large-Scale Graph Processing.

Balancing Memory Accesses for Energy-Efficient Graph Analytics Accelerators.

Accelerating Graph-Connected Component Computation with Emerging Processing-In-Memory Architecture.

Exploiting Parallelism with Vertex-Clustering in Processing-In-Memory-based GCN Accelerators

GraphH: A Processing-in-Memory Architecture for Large-Scale Graph Processing

PIMGCN: A ReRAM-Based PIM Design for Graph Convolutional Network Acceleration

Fully Binarized Graph Convolutional Network Accelerator Based on In‐Memory Computing with Resistive Random‐Access Memory

GIM: Versatile GNN Acceleration with Reconfigurable Processing-in-Memory

A Locality-Aware Energy-Efficient Accelerator for Graph Mining Applications.

CGAcc: A Compressed Sparse Row Representation-Based BFS Graph Traversal Accelerator on Hybrid Memory Cube

GShuttle: Optimizing Memory Access Efficiency for Graph Convolutional Neural Network Accelerators