Abstract:Modeling many-body systems has been a long-standing challenge in science, from classical and quantum physics to computational biology. Equivariance is a critical physical symmetry for many-body dynamic systems, which enables robust and accurate prediction under arbitrary reference transformations. In light of this, great efforts have been put on encoding this symmetry into deep neural networks, which significantly boosts the prediction performance of down-streaming tasks. Some general equivariant models which are computationally efficient have been proposed, however, these models have no guarantee on the approximation power and may have information loss. In this paper, we leverage insights from the scalarization technique in differential geometry to model many-body systems by learning the gradient vector fields, which are SE(3) and permutation equivariant. Specifically, we propose the Equivariant Vector Field Network (EVFN), which is built on a novel tuple of equivariant basis and the associated scalarization and vectorization layers. Since our tuple equivariant basis forms a complete basis, learning the dynamics with our EVFN has no information loss and no tensor operations are involved before the final vectorization, which reduces the complex optimization on tensors to a minimum. We evaluate our method on predicting trajectories of simulated Newton mechanics systems with both full and partially observed data, as well as the equilibrium state of small molecules (molecular conformation) evolving as a statistical mechanics system. Experimental results across multiple tasks demonstrate that our model achieves best or competitive performance on baseline models in various types of datasets.

Self-learning Monte Carlo with equivariant Transformer

Equivariant Transformer is all you need

Equivariant Neural Networks for Spin Dynamics Simulations of Itinerant Magnets

Symmetry-enforced self-learning Monte Carlo method applied to the Holstein model

Comprehensive Molecular Representation from Equivariant Transformer

Machine learning force-field model for kinetic Monte Carlo simulations of itinerant Ising magnets

Self-learning Monte Carlo Method and Cumulative Update in Fermion Systems

Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoods

Self-learning Monte Carlo method: Continuous-time algorithm

Equivariant Vector Field Network for Many-Body System Modeling.

EquiMod: An Equivariance Module to Improve Self-Supervised Learning

Deconstructing equivariant representations in molecular systems

Learning Physical Simulation with Message Passing Transformer

Variational Monte Carlo with large patched transformers

Heuristic machinery for thermodynamic studies of SU(N) fermions with neural networks

Self-learning quantum Monte Carlo method in interacting fermion systems

Learning QM/MM Potential using Equivariant Multiscale Model

Relaxed Equivariance via Multitask Learning

Exploiting symmetry in variational quantum machine learning

Learning Probabilistic Symmetrization for Architecture Agnostic Equivariance