Abstract:Realistic reservoir simulation is known to be prohibitively expensive in terms of computation time when increasing the accuracy of the simulation or by enlarging the model grid size. One method to address this issue is to parallelize the computation by dividing the model in several partitions and using multiple CPUs to compute the result using techniques such as MPI and multi-threading. Alternatively, GPUs are also a good candidate to accelerate the computation due to their massively parallel architecture that allows many floating point operations per second to be performed. The numerical iterative solver takes thus the most computational time and is challenging to solve efficiently due to the dependencies that exist in the model between cells. In this work, we evaluate the OPM Flow simulator and compare several state-of-the-art GPU solver libraries as well as custom developed solutions for a BiCGStab solver using an ILU0 preconditioner and benchmark their performance against the default DUNE library implementation running on multiple CPU processors using MPI. The evaluated GPU software libraries include a manual linear solver in OpenCL and the integration of several third party sparse linear algebra libraries, such as cuSparse, rocSparse, and amgcl. To perform our bench-marking, we use small, medium, and large use cases, starting with the public test case NORNE that includes approximately 50k active cells and ending with a large model that includes approximately 1 million active cells. We find that a GPU can accelerate a single dual-threaded MPI process up to 5.6 times, and that it can compare with around 8 dual-threaded MPI processes.

GPUs: An Oasis in the Supercomputing Desert

Accelerating Lattice QCD Simulations using GPUs

The L-CSC cluster: Optimizing power efficiency to become the greenest supercomputer in the world in the Green500 list of November 2014

Coulomb, Landau and maximally Abelian gauge fixing in lattice QCD with multi-GPUs

The L-CSC cluster: greenest supercomputer in the world in Green500 list of November 2014

A Flexible Patch-Based Lattice Boltzmann Parallelization Approach for Heterogeneous GPU-CPU Clusters

Advanced Architectures for Astrophysical Supercomputing

Performance engineering for the Lattice Boltzmann method on GPGPUs: Architectural requirements and performance results

An Evaluation and Comparison of GPU Hardware and Solver Libraries for Accelerating the OPM Flow Reservoir Simulator

Multi-GPU RI-HF Energies and Analytic Gradients $-$ Towards High Throughput Ab Initio Molecular Dynamics

GPU Acceleration of Numerical Atomic Orbitals-Based Density Functional Theory Algorithms within the ABACUS package

Performance Portable Graphics Processing Unit Acceleration of a High-Order Finite Element Multiphysics Application

High Performance Computing Via a GPU

Architecture Specific Generation of Large Scale Lattice Boltzmann Methods for Sparse Complex Geometries

A Hierarchical Grid Algorithm for Accelerating High-Performance Conjugate Gradient Benchmark on Sunway Many-Core Processor

Accelerating CFD simulation with high order finite difference method on curvilinear coordinates for modern GPU clusters

Enabling and Scaling the HPCG Benchmark on the Newest Generation Sunway Supercomputer with 42 Million Heterogeneous Cores

On the Efficient Evaluation of the Exchange Correlation Potential on Graphics Processing Unit Clusters

GPU-Acceleration of Parallel Unconditionally Stable Group Explicit Finite Difference Method

Toward HPC application portability via C++ PSTL: the Gaia AVU-GSR code assessment

The anachronism of whole-GPU accounting