Abstract:3D many-core NoCs are emerging architectures for future high-performance single chips due to its integration of many processor cores and memories by stacking multiple layers. In such architecture, because processor cores and memories reside in different locations (center, corner, edge, etc.), memory accesses behave differently due to their different communication distances, and the performance (latency) gap of different memory accesses becomes larger as the network size is scaled up. This phenomenon may lead to very high latencies suffered from by some memory accesses, thus degrading the system performance. To achieve high performance, it is crucial to reduce the number of memory accesses with very high latencies. However, this should be done with care since shortening the latency of one memory access can worsen the latency of another as a result of shared network resources. Therefore, the goal should focus on narrowing the latency difference of memory accesses. In the paper, we address the goal by proposing to prioritize the memory access packets based on predicting the round-trip routing latencies of memory accesses. The communication distance and the number of the occupied items in the buffers in the remaining routing path are used to predict the round-trip latency of a memory access. The predicted round-trip routing latency is used as the base to arbitrate the memory access packets so that the memory access with potential high latency can be transferred as early and fast as possible, thus equalizing the memory access latencies as much as possible. Experiments with varied network sizes and packet injection rates prove that our approach can achieve the goal of memory access equalization and outperforms the classic round-robin arbitration in terms of maximum latency, average latency, and LSD1. In the experiments, the maximum improvement of the maximum latency, the average latency and the LSD are 80%, 14%, and 45% respectively.

Low-power Low-Latency Optical Network Architecture for Memory Access Communication

Optical interconnection network for parallel access to multi-rank memory in future computing systems

A Physical-Aware Framework for Memory Network Design Space Exploration

An Optimized Low-Power Optical Memory Access Network for Kilocore Systems

SAMNoC: A Novel Optical Network-on-Chip for Energy-Efficient Memory Access

A Scalable Low-Power Optical Chip: Realization and Static Loss Analysis

On The Design Of A 3d Optical Interconnected Memory System

Memory Access Analysis of Many-Core System with Abundant Bandwidth

SOIN: Scalable Optical Interconnect Network for On-Chip Parallel Memory Access

An Inter/Intra-Chip Optical Network for Manycore Processors

A Hybrid Photonic Burst-Switched Interconnection Network for Large-Scale Manycore System

Energy-Efficient Hybrid Optical-Electronic Network-On-Chip for Future Many-Core Processors

Time-division-multiplexing–wavelength- Division-Multiplexing-based Architecture for ONoC

Optical Caching Network: A Seamless Bridge Between Electrical Packet Switching and Optical Circuit Switching

Achieving Memory Access Equalization Via Round-Trip Routing Latency Prediction in 3D Many-Core NoCs

Mronoc: A Low Latency and Energy Efficient on Chip Optical Interconnect Architecture

Low Latency and Energy Efficient Optical Network-On-Chip Using Wavelength Assignment

Toward a High-Performance and Low-Loss Clos–Benes-Based Optical Network-on-Chip Architecture

A Novel Free-memory Communication Interface of Many Cores Processor

A Low-Latency and Low-Power Hybrid Scheme for On-Chip Networks

Unified Inter- and Intra-chip Optical Interconnect Networks