Abstract:Many learning tasks, including learning potential energy surfaces from ab initio calculations, involve global spatial symmetries and permutational symmetry between atoms or general particles. Equivariant graph neural networks are a standard approach to such problems, with one of the most successful methods employing tensor products between various tensors that transform under the spatial group. However, as the number of different tensors and the complexity of relationships between them increase, maintaining parsimony and equivariance becomes increasingly challenging. In this paper, we propose using fusion diagrams, a technique widely employed in simulating SU($2$)-symmetric quantum many-body problems, to design new equivariant components for equivariant neural networks. This results in a diagrammatic approach to constructing novel neural network architectures. When applied to particles within a given local neighborhood, the resulting components, which we term "fusion blocks," serve as universal approximators of any continuous equivariant function defined in the neighborhood. We incorporate a fusion block into pre-existing equivariant architectures (Cormorant and MACE), leading to improved performance with fewer parameters on a range of challenging chemical problems. Furthermore, we apply group-equivariant neural networks to study non-adiabatic molecular dynamics of stilbene cis-trans isomerization. Our approach, which combines tensor networks with equivariant neural networks, suggests a potentially fruitful direction for designing more expressive equivariant neural networks.

Neural Network Gauge Field Transformation for 4D SU(3) gauge fields

Gauge covariant neural network for quarks and gluons

Machine learning a fixed point action for SU(3) gauge theory with a gauge equivariant convolutional neural network

General Neural Gauge Fields

Gauge Invariant and Anyonic Symmetric Transformer and RNN Quantum States for Quantum Lattice Models

Geometrical aspects of lattice gauge equivariant convolutional neural networks

MLMC: Machine Learning Monte Carlo for Lattice Gauge Theory

Deep learning lattice gauge theories

Signal-to-noise improvement through neural network contour deformations for 3D $SU(2)$ lattice gauge theory

Quantum Gauge Networks: A New Kind of Tensor Network

Scaling of Stochastic Normalizing Flows in $\mathrm{SU}(3)$ lattice gauge theory

Protecting gauge symmetries in the the dynamics of SU(3) lattice gauge theories

Lie-Equivariant Quantum Graph Neural Networks

Gauge-Invariant Noncompact Lattice Simulations

Machine Learning Holographic Mapping by Neural Network Renormalization Group

Simulating (2+1)D SU(2) Yang-Mills Lattice Gauge Theory at finite density with tensor networks

Synthetic Non-Abelian Gauge Fields for Non-Hermitian Systems

A modified Cayley transform for SU(3)

Suppressing Gauge Drift in Quantum Simulations with Gauge Transformations

Unifying O(3) Equivariant Neural Networks Design with Tensor-Network Formalism