Abstract:Modern DRAM cells are periodically refreshed to prevent data loss due to leakage. Commodity DDR DRAM refreshes cells at the rank level. This degrades performance significantly because it prevents an entire rank from serving memory requests while being refreshed. DRAM designed for mobile platforms, LPDDR DRAM, supports an enhanced mode, called per-bank refresh, that refreshes cells at the bank level. This enables a bank to be accessed while another in the same rank is being refreshed, alleviating part of the negative performance impact of refreshes. However, there are two shortcomings of per-bank refresh. First, the per-bank refresh scheduling scheme does not exploit the full potential of overlapping refreshes with accesses across banks because it restricts the banks to be refreshed in a sequential round-robin order. Second, accesses to a bank that is being refreshed have to wait. To mitigate the negative performance impact of DRAM refresh, we propose two complementary mechanisms, DARP (Dynamic Access Refresh Parallelization) and SARP (Subarray Access Refresh Parallelization). The goal is to address the drawbacks of per-bank refresh by building more efficient techniques to parallelize refreshes and accesses within DRAM. First, instead of issuing per-bank refreshes in a round-robin order, DARP issues per-bank refreshes to idle banks in an out-of-order manner. Furthermore, DARP schedules refreshes during intervals when a batch of writes are draining to DRAM. Second, SARP exploits the existence of mostly-independent subarrays within a bank. With minor modifications to DRAM organization, it allows a bank to serve memory accesses to an idle subarray while another subarray is being refreshed. Extensive evaluations show that our mechanisms improve system performance and energy efficiency compared to state-of-the-art refresh policies and the benefit increases as DRAM density increases.

Lazy Precharge: An overhead-free method to reduce precharge overhead for memory parallelism improvement of DRAM system

Design Of A Dynamic Memory Access Scheduler

Exploring DRAM Cache Prefetching for Pooled Memory

Half-DRAM: A High-Bandwidth and Low-Power DRAM Architecture from the Rethinking of Fine-Grained Activation

Read-Tuned STT-RAM and eDRAM Cache Hierarchies for Throughput and Energy Enhancement

A Study of Leveraging Memory Level Parallelism for DRAM System on Multi-core/Many-Core Architecture

Prefetching Techniques for STT-RAM Based Last-Level Cache in CMP Systems

Reducing Performance Impact of DRAM Refresh by Parallelizing Refreshes with Accesses

Improving DRAM Performance by Parallelizing Refreshes with Accesses

Enabling the Adoption of Processing-in-Memory: Challenges, Mechanisms, Future Research Directions

FASA-DRAM: Reducing DRAM Latency with Destructive Activation and Delayed Restoration

Prefetch-directed Scheme for Accelerating Memory Accesses of PCIe-based I/O Subsystem

Efficient Memory Partitioning For Parallel Data Access Via Data Reuse

Pre-Execution Directed Prefetching for In-Order Processors

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

An Efficient Memory Partitioning Approach for Multi-Pattern Data Access via Data Reuse

KUMMS: Optimising DRAM Locality with Kernel-user Behaviours.

Asynchronous Memory Access Unit: Exploiting Massive Parallelism for Far Memory Access

Efficient Memory Partitioning for Parallel Data Access in FPGA via Data Reuse

Banshee: Bandwidth-Efficient DRAM Caching Via Software/Hardware Cooperation

A Hybrid Main Memory Architecture Design for Reducing DRAM System Refresh Power