Abstract:Asymmetric multicore processors (AMPs) couple high-performance big cores and low-power small cores with the same instruction-set architecture but different features, such as clock frequency or microarchitecture. Previous work has shown that asymmetric designs may deliver higher energy efficiency than symmetric multicores for diverse workloads. Despite their benefits, AMPs pose significant challenges to runtime systems of parallel programming models. While previous work has mainly explored how to efficiently execute task-based parallel applications on AMPs, via enhancements in the runtime system, improving the performance of unmodified data-parallel applications on these architectures is still a big challenge. In this work we analyze the particular case of loop-based OpenMP applications, which are widely used today in scientific and engineering domains, and constitute the dominant application type in many parallel benchmark suites used for performance evaluation on multicore systems. We observed that conventional loop-scheduling OpenMP approaches are unable to efficiently cope with the load imbalance that naturally stems from the different performance delivered by big and small cores. To address this shortcoming, we propose \textit{Asymmetric Iteration Distribution} (AID), a set of novel loop-scheduling methods for AMPs that distribute iterations unevenly across worker threads to efficiently deal with performance asymmetry. We implemented AID in \textit{libgomp} --the GNU OpenMP runtime system--, and evaluated it on two different asymmetric multicore platforms. Our analysis reveals that the AID methods constitute effective replacements of the \texttt{static} and \texttt{dynamic} methods on AMPs, and are capable of improving performance over these conventional strategies by up to 56\% and 16.8\%, respectively.

Hybrid MPI+OpenMP Reactive Work Stealing in Distributed Memory in the PDE Framework sam(oa)^2

Lightweight Task Offloading Exploiting MPI Wait Times for Parallel Adaptive Mesh Refinement

Adaptive Asynchronous Work-Stealing for distributed load-balancing in heterogeneous systems

Performance Analysis and Optimization of a Hybrid Distributed Reverse Time Migration Application

Hierarchical Dynamic Loop Self-Scheduling on Distributed-Memory Systems Using an MPI+MPI Approach

A Two-Level Parallel Decomposition Approach for Transient Stability Constrained Optimal Power Flow

Load Balancing For High Performance Computing Using Quantum Annealing

MPI+X:Massive Parallelization and Dynamic Load Balance of a Production-level Unstructured DSMC Solver

HDOT -- an Approach Towards Productive Programming of Hybrid Applications

Enabling performance portability of data-parallel OpenMP applications on asymmetric multicore processors

Performance Analysis of Work Stealing in Large-scale Multithreaded Computing

Exploiting Parallelism on Shared Memory in the QED Particle-in-Cell Code PICADOR with Greedy Load Balancing

A Communication- and Memory-Aware Model for Load Balancing Tasks

On the Galactic Evolution of $D$ and $^3He$

Parallel SPH modeling using dynamic domain decomposition and load balancing displacement of Voronoi subdomains

Cluster-level tuning of a shallow water equation solver on the Intel MIC architecture

OpenMP Compiler for Distributed Memory Architectures

A Case Study on Addressing Complex Load Imbalance in OpenMP

Numerical eigen-spectrum slicing, accurate orthogonal eigen-basis, and mixed-precision eigenvalue refinement using OpenMP data-dependent tasks and accelerator offload

MPI+Threads: runtime contention and remedies

Design and implementation of self-adaptable parallel algorithms for scientific computing on highly heterogeneous HPC platforms