Abstract:The International Journal of High Performance Computing Applications, Ahead of Print. As part of a project aimed at exploring the use of next-generation high-performance computing technologies for numerical weather prediction, we have ported two physics modules from the Common Community Physics Package (CCPP) to Graphics Processing Unit (GPU) and obtained accelerations of up to 10× relative to a comparable multi-core CPU. The physics parameterizations accelerated in this work are the aerosol-aware Thompson microphysics (TH) scheme and the Grell–Freitas (GF) cumulus convection scheme. Microphysics schemes are among the most time-consuming physics parameterizations, second to only radiative process schemes, and our results show better acceleration for the TH scheme than the GF scheme. Multi-GPU implementations of the schemes show acceptable weak scaling in a single node with 8 GPUs, and perfect weak scaling on multiple nodes using one GPU per node. The lack of inter-node communication for column physics parameterizations contributes to their scalability, however, physics parameterizations are run along with dynamics, so the overall multi-GPU performance is often governed by the latter. In the context of optimizing CCPP physics modules, our observations underscore that the extensive use of automatic arrays within inner subroutines hampers GPU performance due to serialized memory allocations. We have used the OpenACC directive programming language for this work because it allows for easy porting of large amounts of code and makes code maintenance more manageable compared to low-level languages like CUDA and OpenCL.

Extending the ARC Information Providers to report information on GPU resources

Efficient Resource Sharing Through GPU Virtualization on Accelerated High Performance Computing Systems

Beyond Desktop Computation: Challenges in Scaling a GPU Infrastructure

CrystalGPU: Transparent and Efficient Utilization of GPU Power

High Performance Computing Via a GPU

Accelerating atmospheric physics parameterizations using graphics processing units

GPU coprocessors as a service for deep learning inference in high energy physics

Accelerated Many‐Core GPU Computing for Physics and Astrophysics on Three Continents

A MapReduce Computing Framework Based on GPU Cluster.

State-of-the-Art on Query & Transaction Processing Acceleration

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps

GMH: A Message Passing Toolkit for GPU Clusters

Tools for GPU Computing - Debugging and Performance Analysis of Heterogenous HPC Applications

Application Experiences on a GPU-Accelerated Arm-based HPC Testbed

Real-time data processing with GPUs in high energy physics

Accelerating the Rate of Astronomical Discovery with GPU-Powered Clusters

Advanced Architectures for Astrophysical Supercomputing

Computing trends using graphic processor in high energy physics

Analyzing the HCP Datasets using GPUs: The Anatomy of a Science Engagement

The anachronism of whole-GPU accounting

Overcoming Limitations of GPGPU-Computing in Scientific Applications