Abstract:Emerging memory technologies such as STT-RAM, PCRAM, and resistive RAM are being explored as potential replacements to existing on-chip caches or main memories for future multi-core architectures. This is due to the many attractive features these memory technologies posses: high density, low leakage, and non-volatility. However, the latency and energy overhead associated with the write operations of these emerging memories has become a major obstacle in their adoption. Previous works have proposed various circuit and architectural level solutions to mitigate the write overhead. In this paper, we study the integration of STT-RAM in a 3D multi-core environment and propose solutions at the on-chip network level to circumvent the write overhead problem in the cache architecture with STT-RAM technology. Our scheme is based on the observation that instead of staggering requests to a write-busy STT-RAM bank, the network should schedule requests to other idle cache banks for effectively hiding the latency. Thus, we prioritize cache accesses to the idle banks by delaying accesses to the STT-RAM cache banks that are currently serving long latency write requests. Through a detailed characterization of the cache access patterns of 42 applications, we propose an efficient mechanism to facilitate such delayed writes to cache banks by (a) accurately estimating the busy time of each cache bank through logical partitioning of the cache layer and (b) prioritizing packets in a router requesting accesses to idle banks. Evaluations on a 3D architecture, consisting of 64 cores and 64 STT-RAM cache banks, show that our proposed approach provides 14% average IPC improvement for multi-threaded benchmarks, 19% instruction throughput benefits for multi-programmed workloads, and 6% latency reduction compared to a recently proposed write buffering mechanism.

Circuit and Microarchitecture Evaluation of 3D Stacking Magnetic RAM (MRAM) As a Universal Memory Replacement

A Novel Architecture Of The 3d Stacked Mram L2 Cache For Cmps

Exploring the vulnerability of CMPs to soft errors with 3D stacked non-volatile memory

Architectural Design of High-Capacity Cache Based on MRAM Technology

Design of an Area-Efficient Computing in Memory Platform Based on STT-MRAM

A Survey of MRAM-Centric Computing: from Near Memory to in Memory

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

RAM and TCAM Designs by Using STT-MRAM

Area-Aware Optimization of MRAM Crossbar Array Bit-Cell for In-Memory Computing

Computing-in-Memory Paradigm Based on STT-MRAM with Synergetic Read/Write-Like Modes

System-Technology Co-Optimization for 3D Monolithic Memory-Centric Computing

Monolithic 3D integration of 2D transistors and vertical RRAMs in 1T–4R structure for high-density memory

In-Memory Computing Paradigms by Exploiting the Intrinsic Interactions Between STT and SOT

An Architecture-Level Cache Simulation Framework Supporting Advanced PMA STT-MRAM

Optimization of the 3D multi-level SOT-MRAMs

A 3D Stackable 1T1C DRAM: Architecture, Process Integration and Circuit Simulation

Optimal Design Of Ddr3 Stt-Mram Memory

Write-Efficient STT/SOT Hybrid Triple-Level Cell for High-Density MRAM

A CFMB STT-MRAM-Based Computing-in-Memory Proposal with Cascade Computing Unit for Edge AI Devices

Materials, Processes, Devices and Applications of Magnetoresistive Random Access Memory