Abstract:The Uintah Computational Framework was developed to provide an environment for solving fluid-structure interaction problems on structured adaptive grids on large-scale, long-running, data-intensive problems. Uintah uses a combination of fluid-flow solvers and particle-based methods for solids, together with a novel asynchronou task-based approach with fully automated load balancing. Uintah demonstrates excellent weak and strong scalability at full machine capacity on XSEDE resources such as Ranger and Kraken, and through the use of a hybrid memory approach based on a combination of MPI and Pthreads, Uintah now runs on up to 262k cores on the DOE Jaguar system. In order to extend Uintah to heterogeneous systems, with ever-increasing CPU core counts and additional on-node GPUs, a new dynamic CPU-GPU task scheduler is designed and evaluated in this study. This new scheduler enables Uintah to fully exploit these architectures with support for asynchronous, out-of-order scheduling of both CPU and GPU computational tasks. A new runtime system has also been implemented with an added multi-stage queuing architecture for efficient scheduling of CPU and GPU tasks. This new runtime system automatically handles the details of asynchronous memory copies to and from the GPU and introduces a novel method of pre-fetching and preparing GPU memory prior to GPU task execution. In this study this new design is examined in the context of a developing, hierarchical GPU-based ray tracing radiation transport model that provides Uintah with additional capabilities for heat transfer and electromagnetic wave propagation. The capabilities of this new scheduler design are tested by running at large scale on the modern heterogeneous systems, Keeneland and TitanDev, with up to 360 and 960 GPUs respectively. On these systems, we demonstrate significant speedups per GPU against a standard CPU core for our radiation problem.

UA-AMG Methods for 2-D 1-T Radiation Diffusion Equations and Their CPU-GPU Implementations

Parallel Conjugate Gradient Method Based on Spline Difference Method for the One-Dimensional Heat Equation

HyGrid: A CPU-GPU Hybrid Convolution-Based Gridding Algorithm in Radio Astronomy.

The Implementation of the Three-Dimensional Unified Gas-Kinetic Wave-Particle Method on Multiple Graphics Processing Units

Numerical Study of Geometric Multigrid Methods on CPU--GPU Heterogeneous Computers

Extending DD-$α$AMG on heterogeneous machines

Mapping the Sbr and Tw-Ildcs to Heterogeneous Cpu-Gpu Architecture for Fast Computation of Electromagnetic Scattering

A Fast Unsmoothed Aggregation Algebraic Multigrid Framework for the Large-Scale Simulation of Incompressible Flow.

Heterogeneous parallel computing method for 3D transient nonlinear thermomechanical problems on CPU-GPU platforms

GPU Based Two-Level CMFD Accelerating Two-Dimensional MOC Neutron Transport Calculation

Radiation modeling using the Uintah heterogeneous CPU/GPU runtime system

Two Novel Aggregation-Based Algebraic Multigrid Methods

Employing Graphics Processing Unit Technology, Alternating Direction Implicit Method And Domain Decomposition To Speed Up The Numerical Diffusion Solver For The Biomedical Engineering Research

GPU Acceleration of CFD Algorithm: HSMAC and SIMPLE.

CPU/GPU Computing for Long-Wave Radiation Physics on Large GPU Clusters.

AmgX: A Library for GPU Accelerated Algebraic Multigrid and Preconditioned Iterative Methods

Optimization and acceleration of flow simulations for CFD on CPU/GPU architecture

GPU-accelerated 3D neutron diffusion code based on finite difference method

An efficient multigrid method with preconditioned smoother for two-dimensional anisotropic space-fractional diffusion equations

An Efficient Extrapolation Multigrid Method Based on a HOC Scheme on Nonuniform Rectilinear Grids for Solving 3D Anisotropic Convection–diffusion Problems

Analysis of Parallel Multigrid Methods in Real-Time Fluid Simulation