Abstract:Shared-memory multi-processor/multi-core machines have become a reference for many application contexts. In particular, the recent literature on speculative parallel discrete event simulation has reshuffled the architectural organization of simulation systems in order to deeply exploit the main features of this type of machines. A core aspect dealt with has been the full sharing of the workload at the level of individual simulation events, which enables keeping the rollback incidence minimal. However, making each worker thread continuously switch its execution between events destined to different simulation objects does not favor locality. This problem appears even more evident in the case of Non-Uniform-Memory-Access (NUMA) machines, where memory accesses generating a cache miss to be served by a far NUMA node give rise to both higher latency and higher traffic at the level of the NUMA interconnection. In this article, we propose a workload-sharing algorithm where the worker threads can have short-term binding with specific simulation objects to favor spatial locality. The new bindings—carried out when a thread decides to switch its execution to other simulation objects—are based on both (a) the timeline according to which the object states have passed through the caching hierarchy and (b) the (dynamic) placement of objects within the NUMA architecture. At the same time, our solution still enables the worker threads to focus their activities on the events to be processed whose timestamps are closer to the simulation commit horizon—hence we exploit temporal locality along virtual time and keep the rollback incidence minimal. In our design we exploit lock-free constructs to support scalable thread synchronization while accessing the shared event pool. Furthermore, we exploit a multi-view approach of the event pool content, which additionally favors local accesses to the parts of the event pool that are currently relevant for the thread activity. Our solution has been released as an integration within the USE (Ultimate-Share-Everything) open source speculative simulation platform available to the community. Furthermore, in this article we report the results of an experimental study that shows the effectiveness of our proposal.

On the Galactic Evolution of $D$ and $^3He$

A Communication- and Memory-Aware Model for Load Balancing Tasks

Dynamic Load Balancing for Short-Range Parallel Molecular Dynamics Simulations

A Systematic Comparison of Dynamic Load Balancing Algorithms for Massively Parallel Rigid Particle Dynamics

Distributed dynamic load balancing for task parallel programming

Balancing indivisible real-valued loads in arbitrary networks

Dynamic Load Balancing in GPU-Based Systems - Early Experiments

The Research On Dynamic Load Balancing Algorithm For Heterogeneous Systems

A Dynamic Data Partition Algorithm Oriented to MPI and OpenMP1

Load Balancing For High Performance Computing Using Quantum Annealing

Dynamic On-Line Allocation of Independent Task onto Heterogeneous Computing Systems to Maximize Load Balancing

Molecular Dynamics Simulation On Commodity Shared-Memory Multiprocessor Systems With Lightweight Multithreading

Distributed Selfish Load Balancing with Weights and Speeds

An Empirical Study and Analysis of the Dynamic Load Balancing Techniques Used in Parallel Computing Systems

Hybrid MPI+OpenMP Reactive Work Stealing in Distributed Memory in the PDE Framework sam(oa)^2

Spatial/Temporal Locality-based Load-sharing in Speculative Discrete Event Simulation on Multi-core Machines

Novel Models and Algorithms of Load Balancing for Variable-Structured Collaborative Simulation under HLA/RTI

Parallel SPH modeling using dynamic domain decomposition and load balancing displacement of Voronoi subdomains

MPI+X:Massive Parallelization and Dynamic Load Balance of a Production-level Unstructured DSMC Solver

A dynamic processor allocation policy for multiprogrammed shared-memory multiprocessors

Dynamic Load Balancing Strategies for Graph Applications on GPUs