Abstract:Heterogeneous nodes composed of a multicore CPU and accelerators are today's norm in high-performance computing (HPC) platforms due to their superior performance and energy efficiency. Tools such as OpenCL and hybrid combinations such as OpenMP plus OpenACC are used for developing portable parallel programs for such nodes. However, these tools have some drawbacks, including a lack of compiler support for nested parallelism, performance portability, automatic heterogeneous workload distribution, user-friendly thread placement, and processor affinity essential to the portable performance of hybrid programs executing on such nodes. In this paper, we propose OpenH, a novel programming model and library API for developing portable parallel programs on heterogeneous hybrid servers composed of a multicore CPU and one or more different types of accelerators. OpenH integrates Pthreads, OpenMP, and OpenACC seamlessly to facilitate the development of hybrid parallel programs. An OpenH hybrid parallel program starts as a single main thread, creating a group of Pthreads called hosting Pthreads. A hosting Pthread then leads the execution of a software component of the program, either an OpenMP multithreaded component running on the CPU cores or an OpenACC (or OpenMP) component running on one of the accelerators of the server. The OpenH library provides API functions that allow programmers to get the configuration of the executing environment and bind the hosting Pthreads (and hence the execution of components) of the program to the CPU cores of the hybrid server to get the best performance. We illustrate the OpenH programming model and library API using two hybrid parallel applications based on matrix multiplication and 2D fast Fourier transform for the most general case of a hybrid hyperthreaded server comprising computing devices. Finally, we demonstrate the practical performance and energy consumption of OpenH for the hybrid parallel matrix multiplication application on a server comprising an Intel Icelake multicore CPU and two Nvidia A40 GPUs.

Comparing OpenMP Implementations With Applications Across A64FX Platforms

Ookami: An A64FX Computing Resource

Simulating Stellar Merger using HPX/Kokkos on A64FX on Supercomputer Fugaku

Analysis and MPI Implementation of LQCD Dslash on Sunway TaihuLight*

Ookami: Deployment and Initial Experiences

ECM modeling and performance tuning of SpMV and Lattice QCD on A64FX

Execution‐Cache‐Memory modeling and performance tuning of sparse matrix‐vector multiplication and Lattice quantum chromodynamics on A64FX

Openuh: an Optimizing, Portable Openmp Compiler

A Further Study of Linux Kernel Hugepages on A64FX with FLASH, an Astrophysical Simulation Code

Numerical Performance and Throughput Benchmark for Electronic Structure Calculations in Pc-Linux Systems with New Architectures, Updated Compilers, and Libraries

Porting and Optimizing OpenFOAM on Sunway TaihuLight System

Co-Design and System for the Supercomputer “Fugaku”

OpenMP Compiler for Distributed Memory Architectures

CI/CD Efforts for Validation, Verification and Benchmarking OpenMP Implementations

Porting HPC Applications to AMD Instinct$^\text{TM}$ MI300A Using Unified Memory and OpenMP

Evaluating performance and portability of high-level programming models: Julia, Python/Numba, and Kokkos on exascale nodes

Bridge++ 2.0: Benchmark results on supercomputer Fugaku

OpenACC Vs the Native Programming on Sunway TaihuLight: A Case Study with GTC-P

Enhance the Strong Scaling of LAMMPS on Fugaku

5 ExaFlop/s HPL-MxP Benchmark with Linear Scalability on the 40-Million-Core Sunway Supercomputer.

OpenH: A Novel Programming Model and API for Developing Portable Parallel Programs on Heterogeneous Hybrid Servers