Abstract:An algorithm is presented for the coupled-cluster singles, doubles, and perturbative triples correction [CCSD(T)] method based on the density fitting or the resolution-of-the-identity (RI) approximation for performing calculations on heterogeneous computing platforms composed of multicore CPUs and graphics processing units (GPUs). The directive-based approach to GPU offloading offered by the OpenMP application programming interface has been employed to adapt the most compute-intensive terms in the RI-CCSD amplitude equations with computational costs scaling as <math><mi>O</mi><mrow><mo>(</mo><msubsup><mi>N</mi><mi>O</mi><mn>2</mn></msubsup><msubsup><mi>N</mi><mi>V</mi><mn>4</mn></msubsup><mo>)</mo></mrow></math>, <math><mi>O</mi><mrow><mo>(</mo><msubsup><mi>N</mi><mi>O</mi><mn>3</mn></msubsup><msubsup><mi>N</mi><mi>V</mi><mn>3</mn></msubsup><mo>)</mo></mrow></math>, and <math><mi>O</mi><mrow><mo>(</mo><msubsup><mi>N</mi><mi>O</mi><mn>4</mn></msubsup><msubsup><mi>N</mi><mi>V</mi><mn>2</mn></msubsup><mo>)</mo></mrow></math> (where NO and NV denote the numbers of correlated occupied and virtual orbitals, respectively) and the perturbative triples correction to execute on GPU architectures. The pertinent tensor contractions are performed using an accelerated math library such as cuBLAS or hipBLAS. Optimal strategies are discussed for splitting large data arrays into tiles to fit them into the relatively small memory space of the GPUs, while also minimizing the low-bandwidth CPU-GPU data transfers. The performance of the hybrid CPU-GPU RI-CCSD(T) code is demonstrated on pre-exascale supercomputers composed of heterogeneous nodes equipped with NVIDIA Tesla V100 and A100 GPUs and on the world's first exascale supercomputer named "Frontier", the nodes of which consist of AMD MI250X GPUs. Speedups within the range 4-8× relative to the recently reported CPU-only algorithm are obtained for the GPU-offloaded terms in the RI-CCSD amplitude equations. Applications to polycyclic aromatic hydrocarbons containing 16-66 carbon atoms demonstrate that the acceleration of the hybrid CPU-GPU code for the perturbative triples correction relative to the CPU-only code increases with the molecule size, attaining a speedup of 5.7× for the largest circumovalene molecule (C66H20). The GPU-offloaded code enables the computation of the perturbative triples correction for the C60 molecule using the cc-pVDZ/aug-cc-pVTZ-RI basis sets in 7 min on Frontier when using 12,288 AMD GPUs with a parallel efficiency of 83.1%.

An Efficient RI-MP2 Algorithm for Distributed Many-GPU Architectures

An Efficient RI-MP2 Algorithm for Distributed Many-GPU Architectures

High-performance multi-GPU analytic RI-MP2 energy gradients

Multi-GPU RI-HF Energies and Analytic Gradients $-$ Towards High Throughput Ab Initio Molecular Dynamics

Implementation of the moving particle semi-implicit method for free-surface flows on GPU clusters.

Multi-GPU RI-HF Energies and Analytic Gradients─Toward High-Throughput Ab Initio Molecular Dynamics

Efficient and portable acceleration of quantum chemical many-body methods in mixed floating point precision using OpenACC compiler directives

Accelerating Coupled-Cluster Calculations with GPUs: An Implementation of the Density-Fitted CCSD(T) Approach for Heterogeneous Computing Architectures Using OpenMP Directives

Gpu-Based Parallel Calculation Method For (1)Molecular Weight Distribution Of Batch Free Radical Polymerization

MOIL-opt: Energy-Conserving Molecular Dynamics on a GPU/CPU System

Local Second Order Mo̷ller-Plesset Theory with a Single Threshold Using Orthogonal Virtual Orbitals: A Distributed Memory Implementation

Parallelization strategies for density matrix renormalization group algorithms on shared-memory systems

Distributed Memory, GPU Accelerated Fock Construction for Hybrid, Gaussian Basis Density Functional Theory

Employing multi-GPU power for molecular dynamics simulation: an extension of GALAMOST

Distributed-Memory DMRG via Sparse and Dense Parallel Tensor Contractions

Enhanced molecular dynamics performance with a programmable graphics processor

Ripple : Simplified Large-Scale Computation on Heterogeneous Architectures with Polymorphic Data Layout

Analytical Gradient Using Cluster-in-Molecule RI-MP2 Method for the Geometry Optimizations of Large Systems

Parallel implementation of the Density Matrix Renormalization Group method achieving a quarter petaFLOPS performance on a single DGX-H100 GPU node

GPGPU Supported Cooperative Acceleration in Molecular Dynamics