Abstract:Emerging memory technologies such as STT-RAM, PCRAM, and resistive RAM are being explored as potential replacements to existing on-chip caches or main memories for future multi-core architectures. This is due to the many attractive features these memory technologies posses: high density, low leakage, and non-volatility. However, the latency and energy overhead associated with the write operations of these emerging memories has become a major obstacle in their adoption. Previous works have proposed various circuit and architectural level solutions to mitigate the write overhead. In this paper, we study the integration of STT-RAM in a 3D multi-core environment and propose solutions at the on-chip network level to circumvent the write overhead problem in the cache architecture with STT-RAM technology. Our scheme is based on the observation that instead of staggering requests to a write-busy STT-RAM bank, the network should schedule requests to other idle cache banks for effectively hiding the latency. Thus, we prioritize cache accesses to the idle banks by delaying accesses to the STT-RAM cache banks that are currently serving long latency write requests. Through a detailed characterization of the cache access patterns of 42 applications, we propose an efficient mechanism to facilitate such delayed writes to cache banks by (a) accurately estimating the busy time of each cache bank through logical partitioning of the cache layer and (b) prioritizing packets in a router requesting accesses to idle banks. Evaluations on a 3D architecture, consisting of 64 cores and 64 STT-RAM cache banks, show that our proposed approach provides 14% average IPC improvement for multi-threaded benchmarks, 19% instruction throughput benefits for multi-programmed workloads, and 6% latency reduction compared to a recently proposed write buffering mechanism.

Ultra-Scaled E-Tree-Based SRAM Design and Optimization With Interconnect Focus

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

Computing-in-memory Circuits and Cross-Layer Integrated Design and Optimization: from SRAM to FeFET

A Physical-Aware Framework for Memory Network Design Space Exploration

Read-Tuned STT-RAM and eDRAM Cache Hierarchies for Throughput and Energy Enhancement

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

Cost-Aware Lifetime Yield Analysis of Heterogeneous 3D On-chip Cache

An Architecture-Level Cache Simulation Framework Supporting Advanced PMA STT-MRAM

Architectural Exploration of Application-Specific Resonant SRAM Compute-in-Memory (rCiM)

Analyzing the Performance of 6T SRAM Cell and 64×64 Memory Array at Lower Technology Nodes for Low Power Design

Optimization of the 3D multi-level SOT-MRAMs

Exploiting Challenges of Sub-20 nm CMOS for Affordable Technology Scaling

System and Technology Co-optimization for RRAM Based Computation-in-memory Chip

Design And Optimization Methodology For 3d Rram Arrays

A 512 Kb SRAM in 65nm CMOS with Divided Bitline and Novel Two-Stage Sensing Technique

A High-Throughput Energy–Area-Efficient Computing-in-Memory SRAM Using Unified Charge-Processing Network

Architecture-circuit-technology Co-Optimization for Resistive Random Access Memory-Based Computation-in-memory Chips

Device-Architecture Co-optimization for RRAM-based In-memory Computing.

TriZone: A Design of MLC STT-RAM Cache for Combined Performance, Energy, and Reliability Optimizations

Design guidelines for 3D RRAM cross-point architecture

A Monolithic-3D SRAM Design with Enhanced Robustness and In-Memory Computation Support