Abstract:Emerging memory technologies such as STT-RAM, PCRAM, and resistive RAM are being explored as potential replacements to existing on-chip caches or main memories for future multi-core architectures. This is due to the many attractive features these memory technologies posses: high density, low leakage, and non-volatility. However, the latency and energy overhead associated with the write operations of these emerging memories has become a major obstacle in their adoption. Previous works have proposed various circuit and architectural level solutions to mitigate the write overhead. In this paper, we study the integration of STT-RAM in a 3D multi-core environment and propose solutions at the on-chip network level to circumvent the write overhead problem in the cache architecture with STT-RAM technology. Our scheme is based on the observation that instead of staggering requests to a write-busy STT-RAM bank, the network should schedule requests to other idle cache banks for effectively hiding the latency. Thus, we prioritize cache accesses to the idle banks by delaying accesses to the STT-RAM cache banks that are currently serving long latency write requests. Through a detailed characterization of the cache access patterns of 42 applications, we propose an efficient mechanism to facilitate such delayed writes to cache banks by (a) accurately estimating the busy time of each cache bank through logical partitioning of the cache layer and (b) prioritizing packets in a router requesting accesses to idle banks. Evaluations on a 3D architecture, consisting of 64 cores and 64 STT-RAM cache banks, show that our proposed approach provides 14% average IPC improvement for multi-threaded benchmarks, 19% instruction throughput benefits for multi-programmed workloads, and 6% latency reduction compared to a recently proposed write buffering mechanism.

A Novel Cache Organization for Tiled Chip Multiprocessor

Fast Hierarchical Cache Directory: A Scalable Cache Organization for Large-Scale CMP

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

Building Expressive and Area-Efficient Directories with Hybrid Representation and Adaptive Multi-Granular Tracking

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

Hierarchical Cache Directory for CMP.

Network caching for Chip Multiprocessors

SelectDirectory: a Selective Directory for Cache Coherence in Many-Core Architectures.

A Spatial and Temporal Locality-Aware Adaptive Cache Design with Network Optimization for Tiled Many-Core Architectures.

Network Victim Cache: Leveraging Network-on-Chip for Managing Shared Caches in Chip Multiprocessors

L1 Collective Cache: Managing Shared Data for Chip Multiprocessors

DASH: A duplication-aware flash cache architecture in virtualization environment

Cache Hierarchy Optimization

STLAC: A Spatial and Temporal Locality-Aware Cache and Network-on-chip Codesign for Tiled Many-Core Systems.

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

A Study on Performance and Power Efficiency of Dense Non-Volatile Caches in Multi-Core Systems

Low power instruction cache based on adjacent line linking access

Trade-off between Hit Rate and Hit Latency for Optimizing DRAM Cache

PASCMP: A Novel Cache Framework for Data Mining Application

Lowering Latency of Embedded Memory by Exploiting In-Cell Victim Cache Hierarchy Based on Emerging Multi-Level Memory Devices

Optimal Placement of Cores, Caches and Memory Controllers in Network On-Chip