Abstract:Emerging memory technologies such as STT-RAM, PCRAM, and resistive RAM are being explored as potential replacements to existing on-chip caches or main memories for future multi-core architectures. This is due to the many attractive features these memory technologies posses: high density, low leakage, and non-volatility. However, the latency and energy overhead associated with the write operations of these emerging memories has become a major obstacle in their adoption. Previous works have proposed various circuit and architectural level solutions to mitigate the write overhead. In this paper, we study the integration of STT-RAM in a 3D multi-core environment and propose solutions at the on-chip network level to circumvent the write overhead problem in the cache architecture with STT-RAM technology. Our scheme is based on the observation that instead of staggering requests to a write-busy STT-RAM bank, the network should schedule requests to other idle cache banks for effectively hiding the latency. Thus, we prioritize cache accesses to the idle banks by delaying accesses to the STT-RAM cache banks that are currently serving long latency write requests. Through a detailed characterization of the cache access patterns of 42 applications, we propose an efficient mechanism to facilitate such delayed writes to cache banks by (a) accurately estimating the busy time of each cache bank through logical partitioning of the cache layer and (b) prioritizing packets in a router requesting accesses to idle banks. Evaluations on a 3D architecture, consisting of 64 cores and 64 STT-RAM cache banks, show that our proposed approach provides 14% average IPC improvement for multi-threaded benchmarks, 19% instruction throughput benefits for multi-programmed workloads, and 6% latency reduction compared to a recently proposed write buffering mechanism.

Parallelism-Aware Memory Interference Delay Analysis for COTS Multicore Systems

Mitigating RC-Delay Induced Accuracy Loss in Analog In-Memory Computing: A Non-Compromising Approach

Minimizing Bank Conflict Delay for Real-Time Embedded Multicore Systems via Bank Mapping.

Delay Analysis and Optimization for Inter-Core Interference in Real-Time Embedded Multicore Systems

Timing Analysis of Concurrent Programs Running on Shared Cache Multi-Cores

Poster: revisiting virtual channel memory for performance and fairness on multi-core architecture.

The Importance of Worst-Case Memory Contention Analysis for Heterogeneous SoCs

A Study of Leveraging Memory Level Parallelism for DRAM System on Multi-core/Many-Core Architecture

Timing-aware analysis of shared cache interference for non-preemptive scheduling

Assessing Intel's Memory Bandwidth Allocation for resource limitation in real-time systems

Multicore DRAM Bank-& Row-Conflict Bomb for Timing Attacks in Mixed-Criticality Systems

Per-Bank Bandwidth Regulation of Shared Last-Level Cache for Real-Time Systems

Analyzing Memory Access on CPU-GPGPU Shared LLC Architecture

ITER: an ITERative approach for inter-core timing analysis in statically scheduled cyclic executive systems on COTS multicore platforms for CRTES

Execution Model to Reduce the Interference of Shared Memory in ARINC 653 Compliant Multicore RTOS

Optimal Placement of Cores, Caches and Memory Controllers in Network On-Chip

CXL-Interference: Analysis and Characterization in Modern Computer Systems

Lazy Load Scheduling for Mixed-criticality Applications in Heterogeneous MPSoCs

Software-Based Lightweight Multithreading to Overlap Memory-Access Latencies of Commodity Processors

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

CADS: Core-Aware Dynamic Scheduler for Multicore Memory Controllers