Abstract:Emerging memory technologies such as STT-RAM, PCRAM, and resistive RAM are being explored as potential replacements to existing on-chip caches or main memories for future multi-core architectures. This is due to the many attractive features these memory technologies posses: high density, low leakage, and non-volatility. However, the latency and energy overhead associated with the write operations of these emerging memories has become a major obstacle in their adoption. Previous works have proposed various circuit and architectural level solutions to mitigate the write overhead. In this paper, we study the integration of STT-RAM in a 3D multi-core environment and propose solutions at the on-chip network level to circumvent the write overhead problem in the cache architecture with STT-RAM technology. Our scheme is based on the observation that instead of staggering requests to a write-busy STT-RAM bank, the network should schedule requests to other idle cache banks for effectively hiding the latency. Thus, we prioritize cache accesses to the idle banks by delaying accesses to the STT-RAM cache banks that are currently serving long latency write requests. Through a detailed characterization of the cache access patterns of 42 applications, we propose an efficient mechanism to facilitate such delayed writes to cache banks by (a) accurately estimating the busy time of each cache bank through logical partitioning of the cache layer and (b) prioritizing packets in a router requesting accesses to idle banks. Evaluations on a 3D architecture, consisting of 64 cores and 64 STT-RAM cache banks, show that our proposed approach provides 14% average IPC improvement for multi-threaded benchmarks, 19% instruction throughput benefits for multi-programmed workloads, and 6% latency reduction compared to a recently proposed write buffering mechanism.

Energy-Efficient Runtime Adaptable L1 STT-RAM Cache Design

An Energy-Efficient Scheme for STT-RAM L1 Cache

Read-Tuned STT-RAM and eDRAM Cache Hierarchies for Throughput and Energy Enhancement

HALLS: An Energy-Efficient Highly Adaptable Last Level STT-RAM Cache for Multicore Systems

ARC: DVFS-Aware Asymmetric-Retention STT-RAM Caches for Energy-Efficient Multicore Processors

Asymmetric-access aware optimization for STT-RAM caches with process variations.

SCART: Predicting STT-RAM Cache Retention Times Using Machine Learning

A Cache Energy Optimization Technique for STT-RAM Last Level Cache

A SELECTIVE READ-BEFORE-WRITE SCHEME FOR ENERGY-AWARE SPIN TORQUE TRANSFER RAM (STT-RAM) CACHE DESIGN

Optimized LRU Algorithm for STT-MRAM/SRAM Hybrid Cache Architecture

Design of last-level on-chip cache using spin-torque transfer RAM (STT RAM)

Compiler-Assisted STT-RAM-Based Hybrid Cache for Energy Efficient Embedded Systems.

Low-energy volatile STT-RAM cache design using cache-coherence-enabled adaptive refresh

Probabilistic design methodology to improve run-time stability and performance of STT-RAM caches

Adaptive Placement and Migration Policy for an STT-RAM-based Hybrid Cache

STT-RAM based energy-efficiency hybrid cache for CMPs.

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

Near: A Novel Energy Aware Replacement Policy For Stt-Mram Llcs

Phase Based And Application Based Dynamic Encoding Scheme For Multi-Level Cell Stt-Ram

Cache Coherence Enabled Adaptive Refresh For Volatile Stt-Ram

Write back energy optimization for STT-MRAM based last level cache with data pattern characterization