Abstract:Lagrangian particle dispersion models are indispensable tools for the study of atmospheric transport processes. However, Lagrangian transport simulations can become numerically expensive when large numbers of air parcels are involved. To accelerate these simulations, we made considerable efforts to port the Massive-Parallel Trajectory Calculations (MPTRAC) model to graphics processing units (GPUs). Here we discuss performance optimizations of the major bottleneck of the GPU code of MPTRAC, the advection kernel. Timeline, roofline, and memory analyses of the baseline GPU code revealed that the application is memory-bound, and performance suffers from near-random memory access patterns. By changing the data structure of the horizontal wind and vertical velocity fields of the global meteorological data driving the simulations from structure of arrays (SoAs) to array of structures (AoSs) and by introducing a sorting method for better memory alignment of the particle data, performance was greatly improved. We evaluated the performance on NVIDIA A100 GPUs of the Jülich Wizard for European Leadership Science (JUWELS) Booster module at the Jülich Supercomputing Center, Germany. For our largest test case, transport simulations with 10 8 particles driven by the European Centre for Medium-Range Weather Forecasts (ECMWF) ERA5 reanalysis, we found that the runtime for the full set of physics computations was reduced by 75 %, including a reduction of 85 % for the advection kernel. In addition to demonstrating the benefits of code optimization for GPUs, we show that the runtime of central processing unit (CPU-)only simulations is also improved. For our largest test case, we found a runtime reduction of 34 % for the physics computations, including a reduction of 65 % for the advection kernel. The code optimizations discussed here bring the MPTRAC model closer to applications on upcoming exascale high-performance computing systems and will also be of interest for optimizing the performance of other models using particle methods.

Adapting arepo-rt for Exascale Computing: GPU Acceleration and Efficient Communication

Adapting AREPO-RT for Exascale Computing: GPU Acceleration and Efficient Communication

GPU-RRTMG_SW: Accelerating a Shortwave Radiative Transfer Scheme on GPU

Parallel GPU Optimization of the Shooting and Bouncing Ray Tracing Methodology for Propagation Modeling

Accelerating Lagrangian transport simulations on graphics processing units: performance optimizations of Massive-Parallel Trajectory Calculations (MPTRAC) v2.6

A Novel GPU-Based Acceleration Algorithm for a Longwave Radiative Transfer Model

Accelerating atmospheric physics parameterizations using graphics processing units

RAMSES-yOMP: Performance Optimizations for the Astrophysical Hydrodynamic Simulation Code RAMSES

Parthenon—a performance portable block-structured adaptive mesh refinement framework

accelerating wrf i/o performance with adios2 and network-based streaming

GPU Accelerations on the 3D Elastic RTM Method

High-speed turbulent flows towards the exascale: STREAmS-2 porting and performance

Hybrid radiation hydrodynamics scheme with adaptive gravity-tree-based pseudo-particles

Hybrid Radiation Hydrodynamics scheme with gravity tree-based adaptive optimization algorithm

A Peta-Scalable CPU-GPU Algorithm for Global Atmospheric Simulations

Multi-GPU RI-HF Energies and Analytic Gradients $-$ Towards High Throughput Ab Initio Molecular Dynamics

Accelerating the Lagrangian particle tracking of residence time distributions and source water mixing towards large scales

Solving global shallow water equations on heterogeneous supercomputers

A GPU-Accelerated Modern Fortran Version of the ECHO Code for Relativistic Magnetohydrodynamics

Twelve Times Faster yet Accurate: A New State‐Of‐The‐Art in Radiation Schemes via Performance and Spectral Optimization