Abstract:Poor DRAM technology scaling over the course of many years has caused DRAM-based main memory to increasingly become a larger system bottleneck. A major reason for the bottleneck is that data stored within DRAM must be moved across a pin-limited memory channel to the CPU before any computation can take place. This requires a high latency and energy overhead, and the data often cannot benefit from caching in the CPU, making it difficult to amortize the overhead. Modern 3D-stacked DRAM architectures include a logic layer, where compute logic can be integrated underneath multiple layers of DRAM cell arrays within the same chip. Architects can take advantage of the logic layer to perform processing-in-memory (PIM), or near-data processing. In a PIM architecture, the logic layer within DRAM has access to the high internal bandwidth available within 3D-stacked DRAM (which is much greater than the bandwidth available between DRAM and the CPU). Thus, PIM architectures can effectively free up valuable memory channel bandwidth while reducing system energy consumption. A number of important issues arise when we add compute logic to DRAM. In particular, the logic does not have low-latency access to common CPU structures that are essential for modern application execution, such as the virtual memory and cache coherence mechanisms. To ease the widespread adoption of PIM, we ideally would like to maintain traditional virtual memory abstractions and the shared memory programming model. This requires efficient mechanisms that can provide logic in DRAM with access to CPU structures without having to communicate frequently with the CPU. To this end, we propose and evaluate two general-purpose solutions that minimize unnecessary off-chip communication for PIM architectures. We show that both mechanisms improve the performance and energy consumption of many important memory-intensive applications.

Asynchronous Memory Access Unit: Exploiting Massive Parallelism for Far Memory Access

Asynchronous memory access unit for general purpose processors

Design Of A Dynamic Memory Access Scheduler

A Study of Leveraging Memory Level Parallelism for DRAM System on Multi-core/Many-Core Architecture

HyFarM: Task Orchestration on Hybrid Far Memory for High Performance Per Bit

Near-Memory Parallel Indexing and Coalescing: Enabling Highly Efficient Indirect Access for SpMV

Exploiting Memory Access Patterns to Improve Memory Performance in Data-Parallel Architectures

A Tale of Two Paths: Toward a Hybrid Data Plane for Efficient Far-Memory Applications

14.2 A Compute SRAM with Bit-Serial Integer/Floating-Point Operations for Programmable In-Memory Vector Acceleration

Direct Distributed Memory Access for CMPs

Enabling the Adoption of Processing-in-Memory: Challenges, Mechanisms, Future Research Directions

Poster: revisiting virtual channel memory for performance and fairness on multi-core architecture.

Boosting Data Center Performance Via Intelligently Managed Multi-backend Disaggregated Memory

Agent-Based Memory Access for Many-Core CMPs

A Performance Evaluation of DRAM Access for In-Memory Databases

Near Data Acceleration with Concurrent Host Access

Memory Affinity: Balancing Performance, Power, Thermal and Fairness for Multi-core Systems

PUMA: from Simultaneous to Parallel for Shared Memory System in Multi-core

Global Data Access Optimization Via Load/Store Instruction Extension

Energy Aware Loop Scheduling for High Performance Multi-Module Memory

Efficient In-Memory Computing Architecture Based On Crossbar Arrays