Abstract:The large working sets of commercial and scientific workloads favor a shared L2 cache design that maximizes the aggregate cache capacity and minimizes off-chip memory requests in chip multiprocessors (CMP). There are two important hurdles that restrict the scalability of these chip multiprocessors: the on-chip memory cost of directory and the long L1 miss latencies. This work presents network caching architecture aimed at facing these two important problems. Network caching takes advantage of on-chip networks to manage shared data blocks and directory information in chip multiprocessors. The network caching architecture removes the directory structure from shared L2 caches and stores directory information for the blocks recently cached by L1 caches in the network interface components decreasing on-chip directory memory overhead and improves the scalability. The saved memory space is used as shared data caches or victim caches which are embedded into the network interface components to reduce L1 miss latencies further. This paper develops three network caching designs to reduce L1 miss latencies. The proposed architecture is evaluated based on simulations of a 16-core tiled CMP. First, we demonstrate that network caching architecture provides good scalability. Second, network caching architecture also provides robust performance. Third, different network caching designs have distinct impacts on performance of CMP. Against over the traditional shared L2 cache design, network victim cache (NVC) design improves performance by 23% on average, and up to 34% at best. Network shared cache (NSC) design provides performance improvement by 6% on average, and up to 16% at best. Network directory cache (NDC) design achieves performance improvement by 4% on average, and up to 11% at best.

A New Optical Network-on-Chip Architecture for Chip Multiprocessor

STorus: A New Topology for Optical Network-on-chip.

On Fully Reconfigurable Optical Torus-Based Networks-On-Chip Architecture

A novel micro-ring-based 4 × 4 non-blocking silicon optical router

Star-Wheels Network-on-Chip featuring a self-adaptive mixed topology and a synergy of a circuit - and a packet-switching communication protocol

RCBus: Row-column bus topology for optical network-on-chip

A Digital-Optical System-on-package Module Architecture for High Performance Multiprocessors

A Generic Optical Router Design for Photonic Network-on-Chips

A Star Network Approach in Heterogeneous Multiprocessors System on Chip

Survey on the Networks-on-Chip Interconnection Topologies

Silicon Photonic Network-on-chip and Enabling Components

A Large-Scale Nesting Ring Multi-Chip Architecture for Manycore Processor Systems.

Optical Versus Electrical: Performance Evaluation of Network On-Chip Topologies for UWASN Manycore Processors

A novel network on chip architecture - Stargon

O-Star: An Optical Switching Architecture Featuring Mode and Wavelength-Division Multiplexing for On-Chip Many-Core Systems

SAMNoC: A Novel Optical Network-on-Chip for Energy-Efficient Memory Access

Hierarchical and Reconfigurable Optical/electrical Interconnection Network for High-Performance Computing

HHSR:A Prototype of Network-on-chip with Commands and Data Transferred Separately

Nesting Ring Architecture of Multichip Optical Network on Chip for Many-Core Processor Systems

Network caching for Chip Multiprocessors

Bandwidth-enhanced Photopolymer Waveguide Hologram-Based Optical Backplane