Abstract:The combination of neural networks and quantum Monte Carlo methods has arisen as a promising path forward for highly accurate electronic structure calculations. Previous proposals have combined equivariant neural network layers with a final antisymmetric layer in order to satisfy the antisymmetry requirements of the electronic wavefunction. However, to date it is unclear if one can represent antisymmetric functions of physical interest, and it is difficult to precisely measure the expressiveness of the antisymmetric layer. This work attempts to address this problem by introducing explicitly antisymmetrized universal neural network layers. This approach has a computational cost which increases factorially with respect to the system size, but we are nonetheless able to apply it to small systems to better understand how the structure of the antisymmetric layer affects its performance. We first introduce a generic antisymmetric (GA) neural network layer, which we use to replace the entire antisymmetric layer of the highly accurate ansatz known as the FermiNet. We demonstrate that the resulting FermiNet-GA architecture can yield effectively the exact ground state energy for small atoms and molecules. We then consider a factorized antisymmetric (FA) layer which more directly generalizes the FermiNet by replacing the products of determinants with products of antisymmetrized neural networks. We find, interestingly, that the resulting FermiNet-FA architecture does not significantly outperform the FermiNet. This strongly suggests that the sum of products of antisymmetries is a key limiting aspect of the FermiNet architecture. To explore this further, we investigate a slight modification of the FermiNet, called the full determinant mode, which replaces each product of determinants with a single combined determinant. We find that the full single-determinant FermiNet closes a large part of the gap between the standard single-determinant FermiNet and FermiNet-GA on small atomic and molecular problems. Surprisingly, on the nitrogen molecule at a dissociating bond length of 4.0 Bohr, the full single-determinant FermiNet can outperform the largest standard FermiNet calculation with 64 determinants.

Anti-symmetric Barron functions and their approximation with sums of determinants

On Representing (Anti)Symmetric Functions

Universal Approximation of Symmetric and Anti-Symmetric Functions.

Towards Antisymmetric Neural Ansatz Separation

Exact and Efficient Representation of Totally Anti-Symmetric Functions

Explicitly antisymmetrized neural network layers for variational Monte Carlo simulation

Efficient anti-symmetrization of a neural network layer by taming the sign problem

$O(N^2)$ Universal Antisymmetry in Fermionic Neural Networks

$\widetilde{O}(N^2)$ Representation of General Continuous Anti-symmetric Function

On Representing Electronic Wave Functions with Sign Equivariant Neural Networks

Universal Approximation Theorem and error bounds for quantum neural networks and quantum reservoirs

Some observations on high-dimensional partial differential equations with Barron data

Quantum and classical query complexities of functions of matrices

Efficiency of the hidden fermion determinant states Ansatz in the light of different complexity measures

Efficient Classical Computation of Single-Qubit Marginal Measurement Probabilities to Simulate Certain Classes of Quantum Algorithms

Representation Formulas and Pointwise Properties for Barron Functions

Quantum Fourier analysis for multivariate functions and applications to a class of Schrödinger-type partial differential equations

On permutation symmetries in Bayesian neural network posteriors: a variational perspective

Improving absolute separability bounds for arbitrary dimensions

Unifying view of fermionic neural network quantum states: From neural network backflow to hidden fermion determinant states

Sorting Out Quantum Monte Carlo