Abstract:Poor DRAM technology scaling over the course of many years has caused DRAM-based main memory to increasingly become a larger system bottleneck. A major reason for the bottleneck is that data stored within DRAM must be moved across a pin-limited memory channel to the CPU before any computation can take place. This requires a high latency and energy overhead, and the data often cannot benefit from caching in the CPU, making it difficult to amortize the overhead. Modern 3D-stacked DRAM architectures include a logic layer, where compute logic can be integrated underneath multiple layers of DRAM cell arrays within the same chip. Architects can take advantage of the logic layer to perform processing-in-memory (PIM), or near-data processing. In a PIM architecture, the logic layer within DRAM has access to the high internal bandwidth available within 3D-stacked DRAM (which is much greater than the bandwidth available between DRAM and the CPU). Thus, PIM architectures can effectively free up valuable memory channel bandwidth while reducing system energy consumption. A number of important issues arise when we add compute logic to DRAM. In particular, the logic does not have low-latency access to common CPU structures that are essential for modern application execution, such as the virtual memory and cache coherence mechanisms. To ease the widespread adoption of PIM, we ideally would like to maintain traditional virtual memory abstractions and the shared memory programming model. This requires efficient mechanisms that can provide logic in DRAM with access to CPU structures without having to communicate frequently with the CPU. To this end, we propose and evaluate two general-purpose solutions that minimize unnecessary off-chip communication for PIM architectures. We show that both mechanisms improve the performance and energy consumption of many important memory-intensive applications.

Promote access speed of DRAM memory in Net processor (NP) filed

Design Of A Dynamic Memory Access Scheduler

Network-on-chip-based optimization method for DRAM communication

Optimization of QDR SRAM Controller in Network Processor

Analysis of Tri-Stage Memory Array for High-Speed Packet Buffers

DR DRAM: Accelerating Memory-Read-Intensive Applications

NP-RDMA: Using Commodity RDMA without Pinning Memory

Banshee: Bandwidth-Efficient DRAM Caching Via Software/Hardware Cooperation

Exploring DRAM Cache Prefetching for Pooled Memory

Hybrid Cache Architecture for High Speed Packet Processing

A Low-Cost Reduced-Latency DRAM Architecture With Dynamic Reconfiguration of Row Decoder

An Efficient Scheduling Mechanism With Flow-Based Packet Reordering In A High-Speed Network Processor

A Study of Leveraging Memory Level Parallelism for DRAM System on Multi-core/Many-Core Architecture

High Throughput Memory Data-Path Design For Multi-Core Architecture

FASA-DRAM: Reducing DRAM Latency with Destructive Activation and Delayed Restoration

TBuffer: Constructing a Tail Buffer in DRAM for Flash-Based Main Memory System

PriMe: Per-Flow Network Measurement by Combining SRAM with DRAM.

Enabling the Adoption of Processing-in-Memory: Challenges, Mechanisms, Future Research Directions

A Hop-Parity-Involved Task Schedule for Lightweight Racetrack-Buffer in Energy-Efficient NoCs

Structure design of data buffer for high-speed exchange devices

DPW-LRU: an Efficient Buffer Management Policy Based on Dynamic Page Weight for Flash Memory in Cyber-Physical Systems.