Abstract:Graphics processing units (GPUs) have become a promising architecture to tackle many computational bottlenecks in quantum chemistry calculations. Herein, we present our new development on using GPU to accelerate Hartree-Fock (HF) and density functional theory (DFT) calculations in Beijing Density Functional (BDF) Package. Our program utilizes the OpenCL platform and thus can execute on a variety of computing devices from different companies as NVIDIA and AMD. All time-consuming steps in HF/DFT, such as calculation of electron repulsion integrals (ERIs), the formation of the Fock matrix, and the exchange-correlation (XC) functional related works, have been implemented on the GPU. In our algorithm, the coulomb- and exchange-matrix are calculated directly on GPU by contracting the primitive ERIs with the density matrix. The 1T1PI (1 thread 1 primitive integral) algorithm in which each thread evaluates one primitive ERI, is used to schedule the computational tasks on GPU. To achieve this task, the primitive Gaussian basis shell pairs mu. are first prescreened and sorted according to their values. The Gaussian product theorem (GPT) is applied to each shell pairs and the intermediate values are calculated and copied into the GPU memory for further use. Then, the one-dimensional mapping is used to assign 32 work items (threads) into one workgroup to calculate the J matrix element and the permutation symmetry of the primitive ERIs is fully utilized. To calculate the K matrix, two-dimensional mapping is used and every 64 work items are packed into one workgroup. Permutation symmetry of exchanging the bra pair mu lambda and the ket pair.s is ignored for reducing the expensive commutation between different workgroups on GPU. After a batch of coulomb- or exchange-matrix elements are computed on the GPU, the results are copied back to the CPU and accumulated to the Fock matrix. The XC terms are calculated through a numerical procedure due to the complex form of the XC functionals. We first pack the numerical grids as batches in which one batch has 128 grids. Then the none zero Gaussian basis shells on each grid batch are sifted out. The grid batches and the basis function sieving indices are duplicated on CPU and GPU memory to avoid unnecessary communication between CPU and GPU. The computational tasks are scheduled dynamically according to the grid batches on GPU. All steps as calculating the numerical grids and their weights, electron density and density gradient, the XC functional and its derivative, and the XC energy and the matrix elements of the XC potential, are optimized step by step on GPU. All calculations are carried out in 64-bit double-precision accuracy to achieve the same numerical precision as on the CPU. Benchmark calculations are carried out on several different GPUs from NVIDIA and AMD for assessing the performance of our code. The benchmark result indicates that the algorithm implemented on the GPU can achieve up to 148-fold speedup over a serial CPU implementation, and the total energy calculated on the GPU is as accurate as the resulting calculated on the CPU.

Heterogeneous Programming and Optimization of Gyrokinetic Toroidal Code and Large-Scale Performance Test on TH-1A.

Gyrokinetic Particle Simulation of Microturbulence for General Magnetic Geometry and Experimental Profiles

Modern Gyrokinetic Particle-In-Cell Simulation of Fusion Plasmas on Top Supercomputers

623 Tflop/s HPCG Run on Tianhe-2: Leveraging Millions of Hybrid Cores.

Optimizing and Scaling HPCG on Tianhe-2: Early Experience

Optimization of A Parallel Cfd Code and Its Performance Evaluation on Tianhe-1a

Accelerating High-Order CFD Simulations for Multi-block Structured Grids on the TianHe-1A Supercomputer

Efficient Parallel Implementation of Large Scale 3D Structured Grid CFD Applications on the Tianhe-1A Supercomputer

Collaborating CPU and GPU for Large-Scale High-Order CFD Simulations with Complex Grids on the TianHe-1A Supercomputer

GPIC: A Set of High-Efficiency CUDA Fortran Code Using Gpu for Particle-in-cell Simulation in Space Physics

Porting and Optimizing GTC-P on TaihuLight Supercomputer with OpenACC

Large-Scale Parallelization and Optimization of Lattice QCD on Tianhe New Generation Supercomputer

A Scalable Hybrid Total FETI Method for Massively Parallel FEM Simulations.

Parallel Transient Stability-Constrained Optimal Power Flow Using GPU as Coprocessor.

CPU/GPU Computing for Long-Wave Radiation Physics on Large GPU Clusters.

Hartree-Fock and Density Functional Calculations on Graphics Processing Unit

Performance optimizations for scalable CFD applications on hybrid CPU+MIC heterogeneous computing system with millions of cores

Development and Verification of 2D Kinetic MOC Code Based on GPU

Code Optimization on Kepler GPUs and Xeon Phi

Acceleration for CFD Applications on Large GPU Clusters: an NPB Case Study

A Scheme of Full Kinetic Particle-in-cell Algorithms for GPU Acceleration Using CUDA Fortran Programming