Abstract:We propose Sectored DRAM, a new, low-overhead DRAM substrate that reduces wasted energy by enabling fine-grained DRAM data transfers and DRAM row activation. Sectored DRAM leverages two key ideas to enable fine-grained data transfers and row activation at low chip area cost. First, a cache block transfer between main memory and the memory controller happens in a fixed number of clock cycles where only a small portion of the cache block (a word) is transferred in each cycle. Sectored DRAM augments the memory controller and the DRAM chip to execute cache block transfers in a variable number of clock cycles based on the workload access pattern with minor modifications to the memory controller's and the DRAM chip's circuitry. Second, a large DRAM row, by design, is already partitioned into smaller independent physically isolated regions. Sectored DRAM provides the memory controller with the ability to activate each such region based on the workload access pattern via small modifications to the DRAM chip's array access circuitry. Activating smaller regions of a large row relaxes DRAM power delivery constraints and allows the memory controller to schedule DRAM accesses faster. Compared to a system with coarse-grained DRAM, Sectored DRAM reduces the DRAM energy consumption of highly-memory-intensive workloads by up to (on average) 33% (20%) while improving their performance by up to (on average) 36% (17%). Sectored DRAM's DRAM energy savings, combined with its system performance improvement, allows system-wide energy savings of up to 23%. Sectored DRAM's DRAM chip area overhead is 1.7% the area of a modern DDR4 chip. We hope and believe that Sectored DRAM's ideas and results will help to enable more efficient and high-performance memory systems. To this end, we open source Sectored DRAM at <a class="link-external link-https" href="https://github.com/CMU-SAFARI/Sectored-DRAM" rel="external noopener nofollow">this https URL</a>.

A Power and Temperature Aware DRAM Architecture

Adaptive Energy-Aware Design Of A Multi-Bank Flash-Memory Storage System

A Hybrid Main Memory Architecture Design for Reducing DRAM System Refresh Power

What Your DRAM Power Models Are Not Telling You: Lessons from a Detailed Experimental Study

Delay-Hiding energy management mechanisms for DRAM

Exploiting Page Write Pattern for Power Management of Hybrid Dram/Pram Memory System

CDAR-DRAM - an In-situ Charge Detection and Adaptive Data Restoration DRAM Architecture for Performance and Energy Efficiency Improvement.

A Read-Write Aware Replacement Policy for Phase Change Memory

Half-DRAM: A High-Bandwidth and Low-Power DRAM Architecture from the Rethinking of Fine-Grained Activation

Rank-Aware Dynamic Migrations and Adaptive Demotions for DRAM Power Management

Self-Managing DRAM: A Low-Cost Framework for Enabling Autonomous and Efficient in-DRAM Operations

DR DRAM: Accelerating Memory-Read-Intensive Applications

A Software-hardware Collaborating Framework for Wear Leveling on Phase Change Memory

Page Policy Control with Memory Partitioning for DRAM Performance and Power Efficiency

Understanding Reduced-Voltage Operation in Modern DRAM Chips: Characterization, Analysis, and Mechanisms

Sectored DRAM: A Practical Energy-Efficient and High-Performance Fine-Grained DRAM Architecture

Enabling the Adoption of Processing-in-Memory: Challenges, Mechanisms, Future Research Directions

CDAR-DRAM: Enabling Runtime DRAM Performance and Energy Optimization via In-Situ Charge Detection and Adaptive Data Restoration

Energy-Aware Page Migration in PCM-DRAM Hybrid Memory

Low Power Aging-Aware On-Chip Memory Structure Design by Duty Cycle Balancing.

Synergy of Dynamic Frequency Scaling and Demotion on DRAM Power Management: Models and Optimizations