Abstract:An algorithm is presented for the coupled-cluster singles, doubles, and perturbative triples correction [CCSD(T)] method based on the density fitting or the resolution-of-the-identity (RI) approximation for performing calculations on heterogeneous computing platforms composed of multicore CPUs and graphics processing units (GPUs). The directive-based approach to GPU offloading offered by the OpenMP application programming interface has been employed to adapt the most compute-intensive terms in the RI-CCSD amplitude equations with computational costs scaling as <math><mi>O</mi><mrow><mo>(</mo><msubsup><mi>N</mi><mi>O</mi><mn>2</mn></msubsup><msubsup><mi>N</mi><mi>V</mi><mn>4</mn></msubsup><mo>)</mo></mrow></math>, <math><mi>O</mi><mrow><mo>(</mo><msubsup><mi>N</mi><mi>O</mi><mn>3</mn></msubsup><msubsup><mi>N</mi><mi>V</mi><mn>3</mn></msubsup><mo>)</mo></mrow></math>, and <math><mi>O</mi><mrow><mo>(</mo><msubsup><mi>N</mi><mi>O</mi><mn>4</mn></msubsup><msubsup><mi>N</mi><mi>V</mi><mn>2</mn></msubsup><mo>)</mo></mrow></math> (where NO and NV denote the numbers of correlated occupied and virtual orbitals, respectively) and the perturbative triples correction to execute on GPU architectures. The pertinent tensor contractions are performed using an accelerated math library such as cuBLAS or hipBLAS. Optimal strategies are discussed for splitting large data arrays into tiles to fit them into the relatively small memory space of the GPUs, while also minimizing the low-bandwidth CPU-GPU data transfers. The performance of the hybrid CPU-GPU RI-CCSD(T) code is demonstrated on pre-exascale supercomputers composed of heterogeneous nodes equipped with NVIDIA Tesla V100 and A100 GPUs and on the world's first exascale supercomputer named "Frontier", the nodes of which consist of AMD MI250X GPUs. Speedups within the range 4-8× relative to the recently reported CPU-only algorithm are obtained for the GPU-offloaded terms in the RI-CCSD amplitude equations. Applications to polycyclic aromatic hydrocarbons containing 16-66 carbon atoms demonstrate that the acceleration of the hybrid CPU-GPU code for the perturbative triples correction relative to the CPU-only code increases with the molecule size, attaining a speedup of 5.7× for the largest circumovalene molecule (C66H20). The GPU-offloaded code enables the computation of the perturbative triples correction for the C60 molecule using the cc-pVDZ/aug-cc-pVTZ-RI basis sets in 7 min on Frontier when using 12,288 AMD GPUs with a parallel efficiency of 83.1%.

Real-Time Equation-of-Motion Coupled-Cluster Cumulant Green's Function Method: Heterogeneous Parallel Implementation Based on the Tensor Algebra for Many-Body Methods Infrastructure

Exploring the exact limits of the real-time equation-of-motion coupled cluster cumulant Green's functions

TAMM: Tensor algebra for many-body methods

Parallelized Implementation of the Finite Particle Method for Explicit Dynamics in GPU

Real-time equation-of-motion CC cumulant and CC Green's function simulations of photoemission spectra of water and water dimer

Quantum Electrodynamics Coupled-Cluster Theory: Exploring Photon-Induced Electron Correlations

CAMA: Contact-Aware Matrix Assembly with Unified Collision Handling for GPU-based Cloth Simulation

Sparse tensor based nuclear gradients for periodic Hartree-Fock and low-scaling correlated wave function methods in the CP2K software package: A massively parallel and GPU accelerated implementation

GFCCLib: Scalable and Efficient Coupled-Cluster Green's Function Library for Accurately Tackling Many Body Electronic Structure Problems

Accelerating Coupled-Cluster Calculations with GPUs: An Implementation of the Density-Fitted CCSD(T) Approach for Heterogeneous Computing Architectures Using OpenMP Directives

Approximate Exponential Integrators for Time-Dependent Equation-of-Motion Coupled Cluster Theory

Real-Time Coupled Cluster Theory with Approximate Triples

An Efficient Multi-GPU Implementation for Linear-Response Time-Dependent Density Functional Theory

Approximate Green's Function Coupled Cluster Method Employing Effective Dimension Reduction.

The performance of approximate equation of motion coupled cluster for valence and core states of heavy element systems

Kernel Fusion in Atomistic Spin Dynamics Simulations on Nvidia GPUs using Tensor Core

Simulation of 24,000 Electrons Dynamics: Real-Time Time-Dependent Density Functional Theory (TDDFT) with the Real-Space Multigrids (RMG)

libEMM: A fictious wave domain 3D CSEM modelling library bridging sequential and parallel GPU implementation

Tensor Product Approximation (DMRG) and Coupled Cluster method in Quantum Chemistry

An efficient state-specific frozen natural orbital based equation of motion coupled cluster method for core-ionization energies: theory, implementation and benchmark