Abstract:NestedMP: Taming Complex Configuration Space of Degree of Parallelism for Nested-Parallel Programs. It is beneficial to exploit multiple levels of parallelism for a wide range of applications, because a typical server already has tens of processor cores now. As the number of cores in a computer is increasing rapidly, efficient support of nested parallelism will be more important. However, compared to single-level parallelism, nested-parallelism is much more complicated for programming since its configuration space of degree of parallelism is more complicated. Nowadays parallel programming models such as OpenMP only have naive support for nested parallelism, and programmers need to specify number of threads for each parallel task explicitly to get a reasonable performance. Such method has two drawbacks. First, it is a complicated job to write code to figure out appropriate configurations for different environments and contexts. Second, the runtime system lacks sufficient global information about threads allocation to make optimal decision on task-core mapping, which easily causes significant performance loss. To deal with such problems, we propose NestedMP, a set of directives which extends OpenMP. NestedMP adopts a model that propagate available threads on task tree in a top-down way, which provides global information about threads allocation for runtime system when high level parallel tasks are launched, to help it make locality-aware task-core mapping decisions. On the other side, instead of configuring number of threads explicitly, programmers control that by policies defined in NestedMP. We have written a few benchmarks by NestedMP, which shows NestedMP makes the code more concise on most cases. We have implemented NestedMP in GCC 4.8.2 and tested the performance of these benchmarks on a 4-way 8-core SandyBridge server. The result shows NestedMP improves the performance significantly over GCC's OpenMP implementation.

Implementation and optimization of OpenMP task parallelism on heterogeneous multi-core architecture

Support for OpenMP tasks on cell architecture

The Implementation and Optimization of Irregular Application Task Models Based on the Cell BE Processor

Loading OpenMP to Cell: An Effective Compiler Framework for Heterogeneous Multi-core Chip

Model Driven Iterative Multi-dimensional Parallelization of Multi-task Programs for the Cell BE: A Genetic Algorithm-Based Approach

O2ATH: an OpenMP Offloading Toolkit for the Sunway Heterogeneous Manycore Platform

Adaptive task granularity strategy for OpenMP3.0 task model on cell architecture

Coarse-Grained Task Parallelization by Dynamic Profiling for Heterogeneous SoC-Based Embedded System

A resource allocation model for heterogeneous multi-core Cell

Extending Synchronization Constructs In Openmp To Exploit Pipeline Parallelism On Heterogeneous Multi-Core

Cell heterogeneous multicore pipeline parallel optimization techniques

Heterogeneous Chip Multi-core Processor task scheduling method based on ant colony algorithm

A BPF-Based Task Scheduling Scheme for Heterogeneous Multiprocessor Systems

Automatic Parallelization for Binary on Multi-core Platforms

HeteroPP: A directive‐based heterogeneous cooperative parallel programming framework

Task Parallel Implementation of Matrix Multiplication on Multi-socket Multi-core Architectures.

Performance Monitoring And Analysis Of Task-Based Openmp

A Heterogeneous Data Parallel Computational Model for Cell Broadband Engine

An Extended Openmp Targeting On The Hybrid Architecture Of Smp-Cluster

NestedMP: Taming Complex Configuration Space of Degree of Parallelism for Nested-Parallel Programs

Characterizing Fine-Grain Parallelism on Modern Multicore Platform