Abstract:Graphical Processor Units (GPUs) are nowadays widely used in all-atom molecular simulations because of the advantage of efficient partitioning of atom pairs between the kernels to compute the contributions to energy and forces, thus enabling the treatment of very large systems. Extension of time- and size-scale of computations is also sought through the development of coarse-grained (CG) models, in which atoms are merged into extended interaction sites. Implementation of CG codes on the GPUs, particularly the multiple-GPU platforms is, however, a challenge due to more complicated potentials and removing the explicit solvent, forcing developers to do interaction- rather than space-domain decomposition. In this paper, we propose a design of a multi-GPU coarse-grained simulator and report the implementation of the heavily coarse-grained physics-based UNited RESidue (UNRES) model of polypeptide chains. By moving all computations to GPUs and keeping the communication with CPUs to a minimum, we managed to achieve almost 5-fold speed-up with 8 A100 GPU accelerators for systems with over 200,000 amino-acid residues, this result making UNRES the best scalable coarse-grained software and enabling us to do laboratory-time millisecond-scale simulations of such cell components as tubulin within days of wall-clock time. Program summary Program Title: Multi-GPU UNRES CPC Library link to program files: https://doi.org/10.17632/hz9s4nwncf.1 Developer's repository link: https://projects.task.gda.pl/eurohpcpl-public/unres Licensing provisions: GPLv3 Programming language: Fortran + C++/CUDA Nature of problem: Physics-based simulations of protein systems at biologically relevant time- and size-scale are demanding and consequently require both the simplification of biomolecule representation and substantial computational resources. UNRES (from UNited RESidue) is a physics-based reduced model of polypeptide chains with which to run large-scale coarse-grained simulations of protein structure and dynamics. It enables the researchers to study protein folding, protein dynamics, and protein-protein interactions in a physically realistic manner and further unveil biological processes' mechanisms. Examples of biological applications include studies of amyloid formations, signaling mechanism, and action of molecular chaperones. Solution method: The presented Multi-GPU UNRES relies on a highly optimized GPU implementation of non-central forces using modern CUDA constructs. Fundamentally, it is possible by proposed efficient partitioning and assignment of the interaction domain onto GPU resources. We moved as many computations as possible to the device (GPU) side. In most cases, computations are defined and scheduled as CUDA graphs. In selected cases, scheduling kernels manually yields slightly better performance. To maximize parallelism, multiple CUDA streams are used. Furthermore, the code visibly benefits from a tree-based allreduce shared-memory-based algorithm. Additionally, if present within hardware, peer memory access is enabled between all GPUs and the allreduce algorithm takes advantage of it. This feature has made the UNRES coarse-grained protein model with implicit solvent scalable for multi-GPUs so that we could achieve almost 5-fold speed-up with 8 A100 GPU accelerators for systems with over 200,000 amino-acid residues. Additional comments including restrictions and unusual features (approx. 50-250 words):

Accelerated Conformational Entropy Calculations Using Graphic Processing Units

A Gpu Based Conformational Entropy Calculation Method

Estimating protein complex model accuracy based on ultrafast shape recognition and deep learning in CASP15.

Quantum Chemistry for Solvated Molecules on Graphical Processing Units (GPUs)using Polarizable Continuum Models

Accelerating the Calculation of Protein Molecular Field using GPU Cluster

Gpu-Based Parallel Calculation Method For (1)Molecular Weight Distribution Of Batch Free Radical Polymerization

Molecular Dynamics Simulation Using Graphics Processing Units

Graphics Processing Unit Acceleration and Parallelization of GENESIS for Large-Scale Molecular Dynamics Simulations

Exact analytical algorithm for solvent accessible surface area and derivatives in implicit solvent molecular simulations on GPUs

Accelerating molecular dynamics simulations using Graphics Processing Units with CUDA

GPU-specific algorithms for improved solute sampling in grand canonical Monte Carlo simulations

Molecular dynamics simulation of macromolecules using graphics processing unit

Fast Calculation of Protein Molecular Field and Its Application on Protein Recog-nition Research??

Langevin dynamics simulations of biomolecules on graphics processors

Test and Analysis GPU-Accelerated in Molecular Dynamics Simulation

A Fast Parallel Clustering Algorithm For Molecular Simulation Trajectories

Fast Pairwise Approximation of Solvent Accessible Surface Area for Implicit Solvent Simulations of Proteins on CPUs and GPUs.

MOIL-opt: Energy-Conserving Molecular Dynamics on a GPU/CPU System

Clustering one million molecular structures on GPU within seconds

Accelerating Gor Algorithm Using Cuda

Multi-GPU UNRES for scalable coarse-grained simulations of very large protein systems