Abstract:In modern systems, DRAM-based main memory is significantly slower than the processor. Consequently, processors spend a long time waiting to access data from main memory, making the long main memory access latency one of the most critical bottlenecks to achieving high system performance. Unfortunately, the latency of DRAM has remained almost constant in the past decade. This is mainly because DRAM has been optimized for cost-per-bit, rather than access latency. As a result, DRAM latency is not reducing with technology scaling, and continues to be an important performance bottleneck in modern and future systems. This dissertation seeks to achieve low latency DRAM-based memory systems at low cost in three major directions. First, based on the observation that long bitlines in DRAM are one of the dominant sources of DRAM latency, we propose a new DRAM architecture, Tiered-Latency DRAM (TL-DRAM), which divides the long bitline into two shorter segments using an isolation transistor, allowing one segment to be accessed with reduced latency. Second, we propose a fine-grained DRAM latency reduction mechanism, Adaptive-Latency DRAM, which optimizes DRAM latency for the common operating conditions for individual DRAM module. Third, we propose a new technique, Architectural-Variation-Aware DRAM (AVA-DRAM), which reduces DRAM latency at low cost, by profiling and identifying only the inherently slower regions in DRAM to dynamically determine the lowest latency DRAM can operate at without causing failures. This dissertation provides a detailed analysis of DRAM latency by using both circuit-level simulation with a detailed DRAM model and FPGA-based profiling of real DRAM modules. Our latency analysis shows that our low latency DRAM mechanisms enable significant latency reductions, leading to large improvement in both system performance and energy efficiency.

Trade-off between Hit Rate and Hit Latency for Optimizing DRAM Cache

Reo: Enhancing Reliability and Efficiency of Object-based Flash Caching

Design Of A Dynamic Memory Access Scheduler

Bi-Modal DRAM Cache: Improving Hit Rate, Hit Latency and Bandwidth

Read-Tuned STT-RAM and eDRAM Cache Hierarchies for Throughput and Energy Enhancement

Gemini: Reducing DRAM Cache Hit Latency by Hybrid Mappings

FASA-DRAM: Reducing DRAM Latency with Destructive Activation and Delayed Restoration

Exploring DRAM Cache Prefetching for Pooled Memory

Native DRAM Cache: Re-architecting DRAM as a Large-Scale Cache for Data Centers

Line-Coalescing DRAM Cache

Enabling Efficient Dynamic Resizing of Large DRAM Caches via A Hardware Consistent Hashing Mechanism

TDRAM: Tag-enhanced DRAM for Efficient Caching

Banshee: Bandwidth-Efficient DRAM Caching Via Software/Hardware Cooperation

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

Asymmetric-access aware optimization for STT-RAM caches with process variations.

Design of 3D DRAM and Its Application in 3D Integrated Multi-Core Computing Systems

Replacing 6T SRAMs with 3T1D DRAMs in the L1 Data Cache to Combat Process Variability

Reducing DRAM Latency at Low Cost by Exploiting Heterogeneity

Cooperatively Managing Dynamic Writeback and Insertion Policies in a Last-Level DRAM Cache.

A Low-Cost Reduced-Latency DRAM Architecture With Dynamic Reconfiguration of Row Decoder

Exploiting set-level write non-uniformity for energy-efficient NVM-based hybrid cache