Abstract:We propose Sectored DRAM, a new, low-overhead DRAM substrate that reduces wasted energy by enabling fine-grained DRAM data transfers and DRAM row activation. Sectored DRAM leverages two key ideas to enable fine-grained data transfers and row activation at low chip area cost. First, a cache block transfer between main memory and the memory controller happens in a fixed number of clock cycles where only a small portion of the cache block (a word) is transferred in each cycle. Sectored DRAM augments the memory controller and the DRAM chip to execute cache block transfers in a variable number of clock cycles based on the workload access pattern with minor modifications to the memory controller's and the DRAM chip's circuitry. Second, a large DRAM row, by design, is already partitioned into smaller independent physically isolated regions. Sectored DRAM provides the memory controller with the ability to activate each such region based on the workload access pattern via small modifications to the DRAM chip's array access circuitry. Activating smaller regions of a large row relaxes DRAM power delivery constraints and allows the memory controller to schedule DRAM accesses faster. Compared to a system with coarse-grained DRAM, Sectored DRAM reduces the DRAM energy consumption of highly-memory-intensive workloads by up to (on average) 33% (20%) while improving their performance by up to (on average) 36% (17%). Sectored DRAM's DRAM energy savings, combined with its system performance improvement, allows system-wide energy savings of up to 23%. Sectored DRAM's DRAM chip area overhead is 1.7% the area of a modern DDR4 chip. We hope and believe that Sectored DRAM's ideas and results will help to enable more efficient and high-performance memory systems. To this end, we open source Sectored DRAM at <a class="link-external link-https" href="https://github.com/CMU-SAFARI/Sectored-DRAM" rel="external noopener nofollow">this https URL</a>.

Half-DRAM: A High-Bandwidth and Low-Power DRAM Architecture from the Rethinking of Fine-Grained Activation

New DRAM Logic Parameter Extraction Method Based on Circuit Reduction

FASA-DRAM: Reducing DRAM Latency with Destructive Activation and Delayed Restoration

Sectored DRAM: A Practical Energy-Efficient and High-Performance Fine-Grained DRAM Architecture

A Hybrid Main Memory Architecture Design for Reducing DRAM System Refresh Power

Reducing DRAM Latency at Low Cost by Exploiting Heterogeneity

Self-Managing DRAM: A Low-Cost Framework for Enabling Autonomous and Efficient in-DRAM Operations

Understanding Reduced-Voltage Operation in Modern DRAM Chips: Characterization, Analysis, and Mechanisms

Reducing Performance Impact of DRAM Refresh by Parallelizing Refreshes with Accesses

Lazy Precharge: An overhead-free method to reduce precharge overhead for memory parallelism improvement of DRAM system

Improving DRAM Performance by Parallelizing Refreshes with Accesses

Banshee: Bandwidth-Efficient DRAM Caching Via Software/Hardware Cooperation

Enabling the Adoption of Processing-in-Memory: Challenges, Mechanisms, Future Research Directions

Understanding and Improving the Latency of DRAM-Based Memory Systems

TDRAM: Tag-enhanced DRAM for Efficient Caching

DRAF: A Low-Power DRAM-Based Reconfigurable Acceleration Fabric

What Your DRAM Power Models Are Not Telling You: Lessons from a Detailed Experimental Study

An eDRAM with Logic Technology Using High-Speed R/W and Compact Charge Transfer Refresh Scheme

Simultaneous Many-Row Activation in Off-the-Shelf DRAM Chips: Experimental Characterization and Analysis

Retention-Aware Hybrid Main Memory (RAHMM): Big DRAM and Little SCM