Abstract:Graphics processing units (GPUs) have a strong floating-point capability and a high memory bandwidth in data parallelism and have been widely used in high-performance computing (HPC). Compute unified device architecture (CUDA) is used as a parallel computing platform and programming model for the GPU to reduce the complexity of programming. The programmable GPUs are becoming popular in computational fluid dynamics (CFD) applications. In this work, we propose a hybrid parallel algorithm of the message passing interface and CUDA for CFD applications on multi-GPU HPC clusters. The AUSM + UP upwind scheme and the three-step Runge-Kutta method are used for spatial discretization and time discretization, respectively. The turbulent solution is solved by theK-omega SST two-equation model. The CPU only manages the execution of the GPU and communication, and the GPU is responsible for data processing. Parallel execution and memory access optimizations are used to optimize the GPU-based CFD codes. We propose a nonblocking communication method to fully overlap GPU computing, CPU_CPU communication, and CPU_GPU data transfer by creating two CUDA streams. Furthermore, the one-dimensional domain decomposition method is used to balance the workload among GPUs. Finally, we evaluate the hybrid parallel algorithm with the compressible turbulent flow over a flat plate. The performance of a single GPU implementation and the scalability of multi-GPU clusters are discussed. Performance measurements show that multi-GPU parallelization can achieve a speedup of more than 36 times with respect to CPU-based parallel computing, and the parallel algorithm has good scalability.

Efficient Parallelization of a Two-List Algorithm for the Subset-Sum Problem on a Hybrid CPU/GPU Cluster

A Novel Cooperative Accelerated Parallel Two-List Algorithm for Solving the Subset-Sum Problem on a Hybrid CPU-GPU Cluster.

A Novel CPU-GPU Cooperative Implementation of A Parallel Two-List Algorithm for the Subset-Sum Problem

Online Scheduling on a CPU-GPU Cluster

Online Scheduling of Mixed CPU-GPU Jobs

GPU implementation of a parallel two-list algorithm for the subset-sum problem

A Scalable Hybrid Algorithm for Solving Partial Differential Equations on a Cluster of CPU/GPU

Efficient CPU-GPU Cooperative Computing for Solving the Subset-Sum Problem

A New Hybrid Hierarchical Parallel Algorithm to Enhance the Performance of Large-Scale Structural Analysis Based on Heterogeneous Multicore Clusters

Performance Evaluation of Hybrid Programming Patterns for Large CPU/GPU Heterogeneous Clusters.

AN PARALLEL AND DISTRIBUTED PROGRAMMING SOLUTION BASED ON HETEROGENEOUS GPU CLUSTER

Optimizing HPL Benchmark on Multi-GPU Clusters

Performance Optimization for CPU-GPU Heterogeneous Parallel System

Experience Of Parallelizing Cryo-Em 3d Reconstruction On A Cpu-Gpu Heterogeneous System

Task Scheduling for GPU Heterogeneous Cluster.

Hybrid Parallel Computation of Multi-Group Particle Transport Equations on Multi-Core Cluster Systems

A Self-Adaptive Workload Balancing Algorithm on Gpu Clusters

Hybrid MPI and CUDA Parallelization for CFD Applications on Multi-GPU HPC Clusters

A Efficient Algorithm for Molecular Dynamics Simulation on Hybrid CPU-GPU Computing Platforms

On the Parallelization Optimization Strategy for High Performance Computing Software

Implementation of the CPU/GPU hybrid parallel method of characteristics neutron transport calculation using the heterogeneous cluster with dynamic workload assignment