Abstract:Networks-on-chip (NoCs) are scaled out to build large-scale multi-chip networks to meet the growing demand for computing. However, the traditional router-based NoC architecture has significant limitations: 1) The overhead of routers is high, especially for long-distance traffic that traverses numerous chips and hops; 2) On/off-chip traffic is mixed up, so the local NoC performance is dragged down by the cross-chip traffic; 3) The routing design of intra/inter-chip networks is also entangled. The alternative router-less solution based on isolated multi-ring (IMR) can address some of these issues; however, the complete lack of routers leads to wiring overhead and limited scalability thus not suitable for large-scale multi-chip networks. Therefore, we are motivated to design a new network architecture that can reduce router/wiring overhead, isolate on/off-chip traffic, and decouple inter/intra-chip routing design by combining the advantages of both routers and router-less rings. In this paper, we propose Ring Road, in which high-speed isolated multi-rings are integrated with compact routers, thus achieving flexible traffic delivery with less router usage and overhead. A polar-coordinate-based description is presented to describe the topology, and corresponding deadlock-free routing algorithms are discussed. As a standalone NoC, Ring Road is low-cost, low-latency, and high-performance. It can also be scaled out into multi-chip networks without redesigning the on-chip routing regardless of inter-chip topology. With low-cost isolated ring channels, no matter how heavy the cross-chip traffic is, the local NoC performance remains consistent. Circuit implementation and post-synthesis analysis show that Ring Road achieves $1.7\sim 2\times$ bandwidth-per-area and $1.6\sim 1.9\times$ bandwidth-per-power compared with the traditional mesh router. Cycle-accurate simulation shows that Ring Road achieves better performance and energy efficiency at various workloads and configurations.

Customized Network-on-Chip for Message Reduction.

Customized Network-on-Chip Oriented to MPI Collective Operations

NetReduce: RDMA-Compatible In-Network Reduction for Distributed DNN Training Acceleration

Lightweight Network-on-chip Router on Research and Design

A Power-Efficient Network-On-Chip for Multi-Core Stream Processors

A Tightly Coupled Network-on-Chip Router Architecture

TrafficLite: A Configurable On-Chip Interconnect Router Microarchitecture

Self-optimizing Two-layer Network-on-Chip Based on Dominant Network-Flow Adaption

Reconfigurable Designs for Networking Silicon.

Run-time Accelerate Channel for Communication-Aware Network-on-Chip

An adaptive buffer-shared routing algorithm for NoC designs

Critical-Path Driven Routers for On-Chip Networks

Mass Message Transmission Aware Buffer-Less Packet-Circuit Switching Router for 3D NoC

Ring Road: A Scalable Polar-Coordinate-based 2D Network-on-Chip Architecture

A Low-Cost and High-Throughput NoC-Aware Chip-to-Chip Interconnection

A Power-Aware Adaptive Routing Scheme for Network on a Chip

Optimizing Buffer Usage For Networks-On-Chip Design

An Ultra-Low Latency Multicast Router for Large-Scale Multi-Chip Neuromorphic Processing

Optimizing Routerless Network-on-Chip Designs: An Innovative Learning-Based Framework

A tree-recursive partitioned multicast mechanism for NoC-based deep neural network accelerator

Design of a High-Throughput NoC Router with Neighbor Flow Regulation