Abstract:We present novel algorithmic solutions together with implementation details utilizing non-Abelian symmetries in order to boost the current limits of tensor network state algorithms on high performance computing infrastructure. In our in-house developed hybrid CPU-multiGPU solution scheduling is decentralized, threads are autonomous and inter-thread communications are solely limited to interactions with globally visible lock-free constructs. Our custom tailored virtual memory management ensures data is produced with high spatial locality, which together with the use of specific sequences of strided batched matrix operations translates to significantly higher overall throughput. In order to lower IO overhead, an adaptive buffering technique is used to dynamically match the level of data abstraction, at which cache repositories are built and reused, to system resources. The non-Abelian symmetry related tensor algebra based on Wigner-Eckhart theorem is fully detached from the conventional tensor network layer, thus massively parallel matrix and tensor operations can be performed without additional overheads. Altogether, we have achieved an order of magnitude increase in performance with respect to results reported in <a class="link-https" data-arxiv-id="2305.05581" href="https://arxiv.org/abs/2305.05581">arXiv:2305.05581</a> in terms of computational complexity and at the same time a factor of three to six in the actual performance measured in TFLOPS. Benchmark results are presented on Hilbert space dimensions up to $2.88\times10^{36}$ obtained via large-scale SU(2) spin adapted density matrix renormalization group simulations on selected strongly correlated molecular systems. These demonstrate the utilization of NVIDIA's highly specialized tensor cores, leading to performance around 110 TFLOPS on a single node supplied with eight NVIDIA A100 devices. In comparison to U(1) implementations with matching accuracy, our solution has an estimated effective performance of 250-500 TFLOPS.

Tensor Network State Algorithms on AI Accelerators

Boosting the effective performance of massively parallel tensor network state algorithms on hybrid CPU-GPU based architectures via non-Abelian symmetries

Cost optimized ab initio tensor network state methods: industrial perspectives

Tensor Network enhanced Dynamic Multiproduct Formulas

Supercomputing tensor networks for U(1) symmetric quantum many-body systems

Efficient Tensor Network Algorithms for Spin Foam Models

Efficient Quantum Circuit Simulation by Tensor Network Methods on Modern GPUs

Tropical Tensor Network for Ground States of Spin Glasses

Efficient 2D Tensor Network Simulation of Quantum Systems

Kernel Fusion in Atomistic Spin Dynamics Simulations on Nvidia GPUs using Tensor Core

Tensor Network Efficiently Representing Schmidt Decomposition of Quantum Many-Body States

Quantum-based Molecular Dynamics Simulations Using Tensor Cores

Quantum tensor network algorithms for evaluation of spectral functions on quantum computers

Tensor Quantum Programming

Two dimensional quantum lattice models via mode optimized hybrid CPU-GPU density matrix renormalization group method

Fine-Grained Tensor Network Methods

Quantum-Inspired Fluid Simulation of 2D Turbulence with GPU Acceleration

Quantum Simulation with Hybrid Tensor Networks

Parallel implementation of the Density Matrix Renormalization Group method achieving a quarter petaFLOPS performance on a single DGX-H100 GPU node

AI-driven Conservative-to-Primitive Conversion in Hybrid Piecewise Polytropic and Tabulated Equations of State