Abstract:Heterogeneous nodes composed of a multicore CPU and accelerators are today's norm in high-performance computing (HPC) platforms due to their superior performance and energy efficiency. Tools such as OpenCL and hybrid combinations such as OpenMP plus OpenACC are used for developing portable parallel programs for such nodes. However, these tools have some drawbacks, including a lack of compiler support for nested parallelism, performance portability, automatic heterogeneous workload distribution, user-friendly thread placement, and processor affinity essential to the portable performance of hybrid programs executing on such nodes. In this paper, we propose OpenH, a novel programming model and library API for developing portable parallel programs on heterogeneous hybrid servers composed of a multicore CPU and one or more different types of accelerators. OpenH integrates Pthreads, OpenMP, and OpenACC seamlessly to facilitate the development of hybrid parallel programs. An OpenH hybrid parallel program starts as a single main thread, creating a group of Pthreads called hosting Pthreads. A hosting Pthread then leads the execution of a software component of the program, either an OpenMP multithreaded component running on the CPU cores or an OpenACC (or OpenMP) component running on one of the accelerators of the server. The OpenH library provides API functions that allow programmers to get the configuration of the executing environment and bind the hosting Pthreads (and hence the execution of components) of the program to the CPU cores of the hybrid server to get the best performance. We illustrate the OpenH programming model and library API using two hybrid parallel applications based on matrix multiplication and 2D fast Fourier transform for the most general case of a hybrid hyperthreaded server comprising computing devices. Finally, we demonstrate the practical performance and energy consumption of OpenH for the hybrid parallel matrix multiplication application on a server comprising an Intel Icelake multicore CPU and two Nvidia A40 GPUs.

Accelerating Green Computing with Hybrid Asymmetric Multicore Architectures and Safe Parallelism

Performance and Power Efficient Massive Parallel Computational Model for HPC Heterogeneous Exascale Systems

Scheduling Garbage Collection for Energy Efficiency on Asymmetric Multicore Processors

Optimization Techniques For Low Energy Consumption In Green Cloud Computing

Pattern-Driven Hybrid Multi- and Many-Core Acceleration in the MPAS Shallow-Water Model

Efficient Resource Sharing Through GPU Virtualization on Accelerated High Performance Computing Systems

Efficient Execution of Microscopy Image Analysis on CPU, GPU, and MIC Equipped Cluster Systems

Optimization of hybrid parallel application execution in heterogeneous high performance computing systems considering execution time and power consumption

Analyzing Parallelization and Program Performance in Heterogeneous MPSoCs

OpenH: A Novel Programming Model and API for Developing Portable Parallel Programs on Heterogeneous Hybrid Servers

Energy-Aware Processor Merging Algorithms for Deadline Constrained Parallel Applications in Heterogeneous Cloud Computing

MultiAmdahl: Optimal Resource Allocation in Heterogeneous Architectures

High-performance computing: Transitioning from Instruction-Level Parallelism to heterogeneous hybrid architectures

Optimizing Offload Performance in Heterogeneous MPSoCs

Energy-Efficient Scheduling of HPC Applications in Cloud Computing Environments

Exploiting Memory Access Patterns to Improve Memory Performance in Data-Parallel Architectures

Balancing Power and Performance in HPC Clouds.

A New Hybrid Hierarchical Parallel Algorithm to Enhance the Performance of Large-Scale Structural Analysis Based on Heterogeneous Multicore Clusters

On the Parallelization Optimization Strategy for High Performance Computing Software

Accelerating Large Scale Image Analyses on Parallel, CPU-GPU Equipped Systems

A Hierarchical Grid Algorithm for Accelerating High-Performance Conjugate Gradient Benchmark on Sunway Many-Core Processor