Abstract:Simulating complex physical systems often involves solving partial differential equations (PDEs) with some closures due to the presence of multi-scale physics that cannot be fully resolved. Although the advancement of high performance computing has made resolving small-scale physics possible, such simulations are still very expensive. Therefore, reliable and accurate closure models for the unresolved physics remains an important requirement for many computational physics problems, e.g., turbulence simulation. Recently, several researchers have adopted generative adversarial networks (GANs), a novel paradigm of training machine learning models, to generate solutions of PDEs-governed complex systems without having to numerically solve these PDEs. However, GANs are known to be difficult in training and likely to converge to local minima, where the generated samples do not capture the true statistics of the training data. In this work, we present a statistical constrained generative adversarial network by enforcing constraints of covariance from the training data, which results in an improved machine-learning-based emulator to capture the statistics of the training data generated by solving fully resolved PDEs. We show that such a statistical regularization leads to better performance compared to standard GANs, measured by (1) the constrained model's ability to more faithfully emulate certain physical properties of the system and (2) the significantly reduced (by up to 80%) training time to reach the solution. We exemplify this approach on the Rayleigh-Bénard convection, a turbulent flow system that is an idealized model of the Earth's atmosphere. With the growth of high-fidelity simulation databases of physical systems, this work suggests great potential for being an alternative to the explicit modeling of closures or parameterizations for unresolved physics, which are known to be a major source of uncertainty in simulating multi-scale physical systems, e.g., turbulence or Earth's climate.

Thermodynamic Fidelity of Generative Models for Ising System

A Thermodynamics-Informed Neural Network for Elastoplastic Constitutive Modeling of Granular Materials

The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instability

Deep Learning the Ising Model Near Criticality

Simulating the Ising Model with a Deep Convolutional Generative Adversarial Network

Nonequilbrium physics of generative diffusion models

Inferring the Isotropic-nematic Phase Transition with Generative Machine Learning

Heat-Bath and Metropolis Dynamics in Ising-like Models on Directed Regular Random Graphs

Machine Learning of Thermodynamic Observables in the Presence of Mode Collapse

Thermodynamic quantities of two-dimensional Ising models obtained by noisy mean-field annealing and a coherent Ising machine

Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems

Deep generative modelling of canonical ensemble with differentiable thermal properties

Thermodynamic analog of integrate-and-fire neuronal networks by maximum entropy modelling

Statistical-Physics-Informed Neural Networks (Stat-PINNs): A Machine Learning Strategy for Coarse-graining Dissipative Dynamics

Machine learning the Ising transition: A comparison between discriminative and generative approaches

Explaining the Machine Learning Solution of the Ising Model

Thermodynamically Informed Multimodal Learning of High-Dimensional Free Energy Models in Molecular Coarse Graining

A comparison of single and double generator formalisms for thermodynamics-informed neural networks

On the generalization ability of coarse-grained molecular dynamics models for non-equilibrium processes

Influence of anisotropy on the study of critical behavior of spin models by machine learning methods

Machine Learning of Nonequilibrium Phase Transition in an Ising Model on Square Lattice