Abstract:Graph traversal is widely used in map routing, social network analysis, causal discovery and many more applications. Because it is a memory-bound process, graph traversal puts significant pressure on the memory subsystem. Due to poor spatial locality and the increasing size of today’s datasets, graph traversal consumes an ever-larger part of application execution time. One way to mitigate this cost is memory prefetching, which issues requests from the processor to the memory in anticipation of needing certain data. However, traditional prefetching does not work well for graph traversal due to data dependencies, the parallel nature of graphs and the need to move vast amounts of data from memory to the caches. In this paper, we propose a compressed sparse row representation-based graph accelerator on the Hybrid Memory Cube (HMC), called CGAcc. CGAcc combines Compressed Sparse Row (CSR) graph representation with in-memory prefetching and processing to improve the performance of graph traversal. Our approach integrates the prefetching and processing in the logic layer of a 3D stacked Dynamic Random-Access Memory (DRAM) architecture, based on Micron’s HMC. We selected HMC to implement CGAcc because it can provide quite high bandwidth and low access latency. Furthermore, this device has multiple DRAM layers connected to internal logic to control memory access and perform rudimentary computation. Using the CSR representation, CGAcc deploys prefetchers in the HMC to exploit the short transaction latency between the logic and DRAM layers. By doing this, it can also avoid large data movement costs. In the runtime, CGAcc pipelines the prefetching to fetch data from DRAM arrays to improve memory-level parallelism. To further reduce the access latency, several optimized internal caches are also introduced to hold the prefetched data to be Processed In-Memory (PIM). A comprehensive evaluation shows the effectiveness of CGAcc. Experimental results showed that, compared to a conventional HMC main memory equipped with a stream prefetcher, CGAcc achieved an average 3.51× speedup with moderate hardware cost.

CMH: compression management for improving capacity in the hybrid memory cube

Design of Ultracompact Content Addressable Memory Exploiting 1T-1MTJ Cell

Dynamic Power Management of Off-Chip Links for Hybrid Memory Cubes

HAM: Hotspot-Aware Manager for Improving Communications With 3D-Stacked Memory

Demystifying the Characteristics of 3D-Stacked Memories: A Case Study for Hybrid Memory Cube

A 28nm 8928Kb/mm 2 -Weight-Density Hybrid SRAM/ROM Compute-in-Memory Architecture Reducing >95% Weight Loading from DRAM.

CARAM: A Content-Aware Hybrid PCM/DRAM Main Memory System Framework

HMCSP: Reducing Transaction Latency of CSR-based SPMV in Hybrid Memory Cube

CGAcc: A Compressed Sparse Row Representation-Based BFS Graph Traversal Accelerator on Hybrid Memory Cube

Hardware Memory Management for Future Mobile Hybrid Memory Systems

Design and Simulation of Content-Aware Hybrid DRAM-PCM Memory System

A hybrid memory architecture supporting fine-grained data migration

Efficient Buffer Management For Pcm-Enhanced Hybrid Memory Architecture

Hardware/software cooperative caching for hybrid DRAM/NVM memory architectures.

CHIME: Energy-Efficient STT-RAM-based Concurrent Hierarchical In-Memory Processing

CRAM: Efficient Hardware-Based Memory Compression for Bandwidth Enhancement

Write-Aware Memory Management in PCM-Based Hybrid Memory Systems

HyMacs

Bandwidth-Effective DRAM Cache for GPUs with Storage-Class Memory

HA-CSD: Host and SSD Coordinated Compression for Capacity and Performance

Efficient Wear Leveling for PCM/DRAM-Based Hybrid Memory.