Abstract:The large working sets of commercial and scientific workloads favor a shared L2 cache design that maximizes the aggregate cache capacity and minimizes off-chip memory requests in chip multiprocessors (CMP). There are two important hurdles that restrict the scalability of these chip multiprocessors: the on-chip memory cost of directory and the long L1 miss latencies. This work presents network caching architecture aimed at facing these two important problems. Network caching takes advantage of on-chip networks to manage shared data blocks and directory information in chip multiprocessors. The network caching architecture removes the directory structure from shared L2 caches and stores directory information for the blocks recently cached by L1 caches in the network interface components decreasing on-chip directory memory overhead and improves the scalability. The saved memory space is used as shared data caches or victim caches which are embedded into the network interface components to reduce L1 miss latencies further. This paper develops three network caching designs to reduce L1 miss latencies. The proposed architecture is evaluated based on simulations of a 16-core tiled CMP. First, we demonstrate that network caching architecture provides good scalability. Second, network caching architecture also provides robust performance. Third, different network caching designs have distinct impacts on performance of CMP. Against over the traditional shared L2 cache design, network victim cache (NVC) design improves performance by 23% on average, and up to 34% at best. Network shared cache (NSC) design provides performance improvement by 6% on average, and up to 16% at best. Network directory cache (NDC) design achieves performance improvement by 4% on average, and up to 11% at best.

A Sharing-Aware Active Pushing Cache Technology on Chip-Multiprocessor

A sharing-aware actively pushing cache on CMP

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

Aap And Aapm: Improved Prefetching Structures Of The L2 Cache

Design of L2 CACHE Replacement Arithmetic for Chip Multiprocessor Architecture

Vscp: A Cache Controlling Method for Improving Single Thread Performance in Multicore System

Pseudo share data cache in multiprocessor: PSDMP

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

A Pollution Alleviative L2 Cache Replacement Policy for Chip Multiprocessor Architecture

L1 Collective Cache: Managing Shared Data for Chip Multiprocessors

A 16-Port Data Cache for Chip Multi-Processor Architecture

DCAPS: dynamic cache allocation with partial sharing

TADC: Thread-aware Divide-and-Conquer Policy to Manage Shared Cache

Performance Evaluation and Optimization of Cache Architecture for Simultaneous Multithreading Processor

PASCMP: A Novel Cache Framework for Data Mining Application

Design Scheme of Directory-based Cooperative Cache in CMP

Network caching for Chip Multiprocessors

High Performance Cache Block Replication Using Re-Reference Probability in CMPs

SRC-based Cache Coherence Protocol in Chip Multiprocessor

Tolerating Memory Latency Using a Hardware-Based Active-Pushing Technique