Abstract:3D many-core NoCs are emerging architectures for future high-performance single chips due to its integration of many processor cores and memories by stacking multiple layers. In such architecture, because processor cores and memories reside in different locations (center, corner, edge, etc.), memory accesses behave differently due to their different communication distances, and the performance (latency) gap of different memory accesses becomes larger as the network size is scaled up. This phenomenon may lead to very high latencies suffered from by some memory accesses, thus degrading the system performance. To achieve high performance, it is crucial to reduce the number of memory accesses with very high latencies. However, this should be done with care since shortening the latency of one memory access can worsen the latency of another as a result of shared network resources. Therefore, the goal should focus on narrowing the latency difference of memory accesses. In the paper, we address the goal by proposing to prioritize the memory access packets based on predicting the round-trip routing latencies of memory accesses. The communication distance and the number of the occupied items in the buffers in the remaining routing path are used to predict the round-trip latency of a memory access. The predicted round-trip routing latency is used as the base to arbitrate the memory access packets so that the memory access with potential high latency can be transferred as early and fast as possible, thus equalizing the memory access latencies as much as possible. Experiments with varied network sizes and packet injection rates prove that our approach can achieve the goal of memory access equalization and outperforms the classic round-robin arbitration in terms of maximum latency, average latency, and LSD1. In the experiments, the maximum improvement of the maximum latency, the average latency and the LSD are 80%, 14%, and 45% respectively.

SLICE Matrix: A Memory Access Scheduling Policy for Multicore Network Processors

Simulink-Based Dynamic Priority Scheduling for Optimization in Network-on-Chip Communication

Automated task distribution in multicore network processors using statistical analysis.

An Efficient Scheduling Mechanism With Flow-Based Packet Reordering In A High-Speed Network Processor

Priority Based Fair Scheduling : A Memory Scheduler Design for Chip-Multiprocessor Systems

Round-Trip Latency Prediction For Memory Access Fairness In Mesh-Based Many-Core Architectures

Multi-core Sharing SDRAM Controller Based on Network Processing

Global Real-Time Memory-Centric Scheduling for Multicore Systems.

Load scheduling for flow-based packet processing on multi-core network processors

Balanced locality-aware packet schedule algrorithm on multi-core network processor

Achieving Memory Access Equalization Via Round-Trip Routing Latency Prediction in 3D Many-Core NoCs

Memory Access Scheduling Based on Dynamic Multilevel Priority in Shared DRAM Systems

Enhancing the Performance and Fairness of Shared DRAM Systems with Sharing-Aware Scheduling

Coordinate Channel-Aware Page Mapping Policy and Memory Scheduling for Reducing Memory Interference among Multimedia Applications.

High-Performance and Energy-Effcient Memory Scheduler Design for Heterogeneous Systems

Memory-centric scheduling for multicore hard real-time systems

Optimization of Shared Memory Controller for Multi-Core System

The Design of NoC-Side Memory Access Scheduling for Energy-Efficient GPGPUs

An Application on Controller to Improve Performance of Multi-Core Shared Memory Based on Network Processing

Optimal Placement of Cores, Caches and Memory Controllers in Network On-Chip

Traffic-Aware Application Mapping for Network-on-Chip Based Multiprocessor System-on-Chip