Abstract:Packet-switched interconnect fabric is a promising on-chip communication solution for many-core architectures. It offers high throughput and excellent scalability for on-chip data and protocol transactions. The main problem posed by this communication fabric is the potentially-high and nondeterministic network latency caused by router data buffering and resource arbitration. This paper describes a new method to minimize on-chip network latency, which is motivated by the observation that only a small percentage of on-chip data and protocol traffic is latency-critical. Existing work focusing on minimizing average network latency is thus suboptimal. Such techniques expend most of the design, area, and power overhead accelerating latency-noncritical traffic for which there is no corresponding application-level speedup. We propose run-time techniques that identify latency-critical traffic by leveraging network data-transaction and protocol information. Latency-critical traffic is permitted to bypass router pipeline stages and latency-noncritical traffic. These techniques are evaluated via a router design that has been implemented using TSMC 65nm technology. Detailed network latency simulation and hardware characterization demonstrate that, for latency-critical traffic, the proposed solution closely approximates the ideal interconnect even under heavy load while preserving throughput for both latency-critical and noncritical traffic.

Run-time Accelerate Channel for Communication-Aware Network-on-Chip

Latency Criticality Aware On-Chip Communication

Traffic-Aware Application Mapping for Network-on-Chip Based Multiprocessor System-on-Chip

A Low-Latency and Low-Power Hybrid Scheme for On-Chip Networks

Self-optimizing Two-layer Network-on-Chip Based on Dominant Network-Flow Adaption

Work in Progress: ACAC: An Adaptive Congestion-aware Approximate Communication Mechanism for Network-on-Chip Systems

A Power-Efficient Network-On-Chip for Multi-Core Stream Processors

A Bypass Optimization Method for Network on Chip

Transaction-Aware Network-on-Chip Resource Reservation

A tree-recursive partitioned multicast mechanism for NoC-based deep neural network accelerator

Critical-Path Driven Routers for On-Chip Networks

A Low-Latency Virtual-Channel Router with Optimized Pipeline Stages for On-Chip Network

CCASM: A Computation- and Communication-Aware Scheduling and Mapping Algorithm for NoC-Based DNN Accelerators

A Deadlock-Free Subnetting Mechanism for High Performance Broadcasting in Noc

A Dynamic and Low Latency Wireless NoC Architecture.

A Low Latency Variance NoC Router

A Tightly Coupled Network-on-Chip Router Architecture

A Network-on-Chip Accelerator for Genome Variant Analysis

Communication Performance Analytical Model and Buffer Allocation Optimizing Algorithm for Network-on-Chip

Accelerating NoC-Based MPI Primitives via Communication Architecture Customization