Abstract:The large working sets of commercial and scientific workloads favor a shared L2 cache design that maximizes the aggregate cache capacity and minimizes off-chip memory requests in chip multiprocessors (CMP). There are two important hurdles that restrict the scalability of these chip multiprocessors: the on-chip memory cost of directory and the long L1 miss latencies. This work presents network caching architecture aimed at facing these two important problems. Network caching takes advantage of on-chip networks to manage shared data blocks and directory information in chip multiprocessors. The network caching architecture removes the directory structure from shared L2 caches and stores directory information for the blocks recently cached by L1 caches in the network interface components decreasing on-chip directory memory overhead and improves the scalability. The saved memory space is used as shared data caches or victim caches which are embedded into the network interface components to reduce L1 miss latencies further. This paper develops three network caching designs to reduce L1 miss latencies. The proposed architecture is evaluated based on simulations of a 16-core tiled CMP. First, we demonstrate that network caching architecture provides good scalability. Second, network caching architecture also provides robust performance. Third, different network caching designs have distinct impacts on performance of CMP. Against over the traditional shared L2 cache design, network victim cache (NVC) design improves performance by 23% on average, and up to 34% at best. Network shared cache (NSC) design provides performance improvement by 6% on average, and up to 16% at best. Network directory cache (NDC) design achieves performance improvement by 4% on average, and up to 11% at best.

Remapping NUCA: Improving NUCA Cache's Power Efficiency

Power-and thermal-aware mapping for NoC under latency constraint

Performance and network power evaluation of tightly mixed SRAM NUCA for 3D Multi-core Network on Chips

Reinforcement Learning Based Data Compression for Energy-Efficient Non-volatile Caches.

An Efficient Algorithm for Mapping Deep Learning Applications on the NoC Architecture

TB-NUCA: A Temperature-Balanced 3D NUCA Based on Bayesian Optimization

Study on the Low Power Cache Design Technique

Last Level Cache Layout Remapping for Heterogeneous Systems

Minimizing Energy Consumption for Embedded Multicore Systems Using Cache Configuration and Task Mapping

WCRT Optimization Scheme Based on Task Mapping and Cache Partitioning

Low power instruction cache based on adjacent line linking access

An Energy-Efficient Last Level Cache Design Using Software and Hardware Collaborative Region-based Management

An Efficient Task Mapping Algorithm with Power-Aware Optimization for Network on Chip

Power Optimization Through Edge Reduction In Lut-Based Fpga Technology Mapping

Task Mapping with Cache Reconfiguration and Partitioning for Energy Minimization on Real-Time Multicores

Reconfiguration Algorithm of Low-Power Reconfigurable Cache

Re-Cache: Mitigating Cache Contention by Exploiting Locality Characteristics with Reconfigurable Memory Hierarchy for GPGPUs.

Performance/Thermal-Aware Design of 3D-Stacked L2 Caches for CMPs

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

Network caching for Chip Multiprocessors

Revisiting the Cache Effect on Multicore Multithreaded Network Processors