Abstract:An efficient computing framework, namely PFlows, for fully resolved-direct numerical simulations of particle-laden flows was accelerated on NVIDIA General Processing Units (GPUs) and GPU-like accelerator (DCU) cards. The framework is featured as coupling the lattice Boltzmann method for fluid flow with the immersed boundary method for fluid-particle interaction, and the discrete element method for particle collision, using two fixed Eulerian meshes and one moved Lagrangian point mesh, respectively. All the parts are accelerated by a fine-grained parallelism technique using CUDA on GPUs, and further using HIP on DCU cards, i.e., the calculation on each fluid grid, each immersed boundary point, each particle motion, and each pair-particle collision is responsible by one computer thread, respectively. Coalesced memory accesses to LBM distribution functions with the data layout of Structure of Arrays are used to maximize utilization of hardware bandwidth. Parallel reduction with shared memory for data of immersed boundary points is adopted for the sake of reducing access to global memory when integrate particle hydrodynamic force. MPI computing is further used for computing on heterogeneous architectures with multiple CPUs-GPUs/DCUs. The communications between adjacent processors are hidden by overlapping with calculations. Two benchmark cases were conducted for code validation, including a pure fluid flow and a particle-laden flow. The performances on a single accelerator show that a GPU V100 can achieve 7.1-11.1 times speed up, while a single DCU can achieve 5.6-8.8 times speed up compared to a single Xeon CPU chip (32 cores). The performances on multi-accelerators show that parallel efficiency is 0.5-0.8 for weak scaling and 0.68-0.9 for strong scaling on up to 64 DCU cards even for the dense flow (4 1/4 20%). The peak performance reaches 179 giga lattice updates per second (GLUPS) on 256 DCU cards by using 1 billion grids and 1 million particles. At last, a large-scale simulation of a gas-solid flow with 1.6 billion grids and 1.6 million particles was conducted using only 32 DCU cards. This simulation shows that the present framework is prospective for simulations of large-scale particle-laden flows in the upcoming exascale computing era. (c) 2022 Chinese Society of Particuology and Institute of Process Engineering, Chinese Academy of Sciences. Published by Elsevier B.V. All rights reserved.

An Efficient Uniform Integrated Advection Algorithm for Finite Time Lyapunov Exponent Field Computation on Gpu and Mic

Parallelized Implementation of the Finite Particle Method for Explicit Dynamics in GPU

UIA: a Uniform Integrated Advection Algorithm for Steady and Unsteady Piecewise Linear Flow Field on Structured and Unstructured Grids

An Efficient Preprocessing and Composition Based Finite-Time Lyapunov Exponent Visualization Algorithm for Unsteady Flow Field

Accelerated Monte Carlo Rendering of Finite-Time Lyapunov Exponents

Acceleration of PDE-based FTLE Calculations on Intel Multi-Core and Many-Core Architectures

Efficient Same-Dimensional Implicit Time Advancement Parallel Scheme and Optimization Methods for the Iteration Parameters Using a Graphics-Processing Unit

doi：10.11871/j.issn.1674-9480.2014.02.005

A Multi-Block Viscous Flow Solver Based on GPU Parallel Methodology

Optimization and acceleration of flow simulations for CFD on CPU/GPU architecture

An adaptive finite element multigrid solver using GPU acceleration

Neural Monte Carlo Rendering of Finite-Time Lyapunov Exponent Fields

GPU Implementation of the Discrete Unified Gas Kinetic Scheme for Low-Speed Isothermal Flows

Massively Parallel Least Squares Finite Element Method with Graphic Processing Unit

GPU Optimization for High-Quality Kinetic Fluid Simulation

Implementation and optimization of <scp>GPU‐based</scp> parallel <scp>one‐step</scp> leapfrog <scp>ADI‐FDTD</scp> for far‐field scattering problems

An efficient flux-reconstructed lattice boltzmann flux solver for flow interaction of multi-structure with curved boundary

Accelerating Unstructured Large Eddy Simulation Solver with GPU

Accelerating Fully Resolved Simulation of Particle-Laden Flows on Heterogeneous Computer Architectures

Implementation and optimization of GPU‐based parallel one‐step leapfrog ADI‐FDTD for far‐field scattering problems

The Immersed Boundary-Lattice Boltzmann Method Parallel Model for Fluid-Structure Interaction on Heterogeneous Platforms