Abstract:On-chip distributed memory system has become an attractive solution for massive parallel memory accesses found in future many-core processors. However, increasing number of on-chip cores and memory controllers inevitably introduce many remote memory accesses, which generate a large amount of on-chip traffic and put great pressure on the interconnection. This paper tries to optimize on-chip memory access traffic via runtime thread migration. We first analyze memory access behaviors in multi-threaded applications and find that the memory access targets and volumes are similar during short periods, which makes runtime prediction feasible. But the memory access targets exhibit great mobility during long periods, motivating us to dynamically move threads towards the data. Based on these observations, we propose a novel low-cost and distributed thread migration algorithm which adjusts thread placement in chains based on benefit estimation. We present details of the workflow, including the trigger and arbitration of migration requests and the procedures to determine the migration chains. Simulation results show that our algorithm achieves system performance speedup of 11.5 % and reduces average memory access latency by 11.0 %. It can find a few but effective thread migrations to optimize on-chip memory access traffic with acceptable hardware and runtime overheads.

Research of On-chip Resource Distribution Strategies for Simultaneous Multithreaded Architecture

A Swarm-Inspired Resource Distribution for SMT Processors.

A Spatially Triggered Dissipative Resource Distribution Policy for SMT Processors

Design of non-critical path resource distributor for SMT processors

A Dynamic Resource Allocation Optimization for SMT Processors

Performance Evaluation and Optimization of Cache Architecture for Simultaneous Multithreading Processor

Resource distribution method for running efficiency instructed reconfigurable chip multiprocessor

Architecture Design of Simultaneous Multithreading VLIW DSP

Dealing with the Functional Units Starvation in SMT

A Survey of Managing Contention for Shared Resources on Multicore Processors

Design Of Multithreaded Coprocessor Ip Core For Embedded Soc Chip

Optimizing Memory Access Traffic Via Runtime Thread Migration for On-Chip Distributed Memory Systems

Design of Multiple Processor Communication Mechanism

Load Balance Scheduling Algorithm for CMP Architecture

Efficient Scratchpad Memory Management Based on Multi-thread for MPSoC Architecture.

Dynamic Simultaneous Multithreaded Architecture

Qswitch: Dynamical Off-Chip Bandwidth Allocation Between Local and Remote Accesses.

Architecture Design of a Single-chip Multiprocessor

Simultaneous Multithreading VLIW DSP Architecture with Dynamic Dispatch Mechanism

CMP Thread Assignment Based on Group Sharing L2 Cache

SYNPA: SMT Performance Analysis and Allocation of Threads to Cores in ARM Processors