Abstract:The large working sets of commercial and scientific workloads favor a shared L2 cache design that maximizes the aggregate cache capacity and minimizes off-chip memory requests in chip multiprocessors (CMP). There are two important hurdles that restrict the scalability of these chip multiprocessors: the on-chip memory cost of directory and the long L1 miss latencies. This work presents network caching architecture aimed at facing these two important problems. Network caching takes advantage of on-chip networks to manage shared data blocks and directory information in chip multiprocessors. The network caching architecture removes the directory structure from shared L2 caches and stores directory information for the blocks recently cached by L1 caches in the network interface components decreasing on-chip directory memory overhead and improves the scalability. The saved memory space is used as shared data caches or victim caches which are embedded into the network interface components to reduce L1 miss latencies further. This paper develops three network caching designs to reduce L1 miss latencies. The proposed architecture is evaluated based on simulations of a 16-core tiled CMP. First, we demonstrate that network caching architecture provides good scalability. Second, network caching architecture also provides robust performance. Third, different network caching designs have distinct impacts on performance of CMP. Against over the traditional shared L2 cache design, network victim cache (NVC) design improves performance by 23% on average, and up to 34% at best. Network shared cache (NSC) design provides performance improvement by 6% on average, and up to 16% at best. Network directory cache (NDC) design achieves performance improvement by 4% on average, and up to 11% at best.

An Implement of Parallel Module Network Learning Algorithm on Distributed Memory Multiprocessors

Parallel Module Network Learning on Distributed Memory Multiprocessors

Parallelization of Module Network Structure Learning and Performance Tuning on SMP

Automated task distribution in multicore network processors using statistical analysis.

Coded Parallelism for Distributed Deep Learning.

Parallelization of Bayesian Network Based SNPs Pattern Analysis and Performance Characterization on SMP/HT

A Prediction Model For Parallel Back Propagation Neural Network On Smp-Cluster

Parallel Efficient Hierarchical Algorithms for Module Placement of Large Chips on Distributed Memory Architectures

Distributed Memory Management Units Architecture for NoC-based CMPs

Distributed Louvain Algorithm for Graph Community Detection

Distributed Memory Implementation of Bron-Kerbosch Algorithm

An Efficient Implementation of Montgomery Multiplication on Multicore Platform With Optimized Algorithm, Task Partitioning, and Network Architecture

A Class of Parallel Algorithms for Solving Large Sparse Linear Systems on Multiprocessors

A Learning Algorithm for Bayesian Networks and Its Efficient Implementation on GPUs

A Parallel Randomized Neural Network on In-Memory Cluster Computing for Big Data.

Network caching for Chip Multiprocessors

Realization of a Neural Network Parallel MIMD Processor

Distributed Path-Based Inference in Semantic Networks

A parallel computing platform for training large scale neural networks

Research and design of distributed neural networks with chip training algorithm

Network Victim Cache: Leveraging Network-on-Chip for Managing Shared Caches in Chip Multiprocessors