Abstract:In a Chip Multiprocessor(CMP) with shared caches, the last level cache (LLC) is distributed across all the cores. This increases the on-chip communication delay and thus influence the pr ocessor's performance. The LLC is also quite inefficient due to plenty of dead blocks. Replication can be provided in shared caches by replicating cache blocks evicted from cores to the local LLC slices to minimize access latency through utilizing the cache space of dead blocks which will not be referenced again before they are evicted. However, naively allowing all evicted blocks to be replicated have limited performance benefit as such replicating does not take into account reuse probability of replicated blocks. This paper proposes Adaptive Probability Replication (APR), a mechanism that counts each block's accesses in L2 cache slices, and monitors the number of evicted blocks with different number of accesses, to estimate the Re-Reference Probability of blocks in their lifetime at runtime. Using predicted re-reference probability, APR adopts probability replication policy and probability insertion policy to replicate blocks at corresponding probabilities, and insert them at appropriate position, according to their re-reference probability. We evaluate APR for a 16-core tiled CMP using splash-2 and parsec benchmarks. APR improves performance by 21% on average compared to conventional shared cache design, by 17% over Victim Replication (VR), by 10% over Adaptive Selective Replication (ASR), and by 15% over Reactive NUCA (R-NUCA). The additional hardware cost of APR is well under 1% of L2 cache slice.

High Performance Cache Block Replication Using Re-Reference Probability in CMPs

Dynamic Reusability-Based Replication with Network Address Mapping in CMPs.

ARP: an Adaptive Replication Policy in Tiled Chip Multiprocessor

Controlled replication: reduce the capacity occupied by redundant replicas in tiled chip multiprocessors

A Perceptron-Based Replication Scheme for Managing the Shared Last Level Cache

Scalable Proximity-Aware Cache Replication in Chip Multiprocessors

A Two-Level Cache Aware Adaptive Data Replication Mechanism for Shared LLC

Proximity-Aware Cache Replication

Replication-aware Cache Management for CMPs with Private LLCs

Reusable data predicting mechanism for shared last level Cache in chip multi-processor

Online Cache Modeling for Commodity Multicore Processors

An Exploration of Page Replication for NoC-Based On-Chip Distributed Memory Systems

Cache Replacement Policies for Improving LLC Performance in Multi-Core Processors

Design of L2 CACHE Replacement Arithmetic for Chip Multiprocessor Architecture

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

An Improved Scheme of Victim Replication in Tiled Chip Multiprocessors

Cache Promotion Policy Using Re-reference Interval Prediction

Reconfigurable Mpb Combined with Cache Coherence Protocol in Many-Core

A Pollution Alleviative L2 Cache Replacement Policy for Chip Multiprocessor Architecture

PACP: A Prefetch-aware Multi-core Shared Cache Partitioning Strategy

Cooperatively Managing Dynamic Writeback and Insertion Policies in a Last-Level DRAM Cache.