Abstract:We developed a new class of physics-informed generative adversarial networks (PI-GANs) to solve forward, inverse, and mixed stochastic problems in a unified manner based on a limited number of scattered measurements. Unlike standard GANs relying solely on data for training, here we encoded into the architecture of GANs the governing physical laws in the form of stochastic differential equations (SDEs) using automatic differentiation. In particular, we applied Wasserstein GANs with gradient penalty (WGAN-GP) for its enhanced stability compared to vanilla GANs. We first tested WGAN-GP in approximating Gaussian processes of different correlation lengths based on data realizations collected from simultaneous reads at sparsely placed sensors. We obtained good approximation of the generated stochastic processes to the target ones even if there is a mismatch between the input noise dimensionality and the effective dimensionality of the target stochastic processes. We also studied the overfitting issue for both the discriminator and the generator, and we found that overfitting occurs also in the generator in addition to the discriminator as previously reported. Subsequently, we considered the solution of elliptic SDEs requiring approximations of three stochastic processes, namely the solution, the forcing, and the diffusion coefficient. Here again, we assumed data collected from simultaneous reads at a limited number of sensors for the multiple stochastic processes. Three generators were used for the PI-GANs: two of them were feed forward deep neural networks (DNNs), while the other one was the neural network induced by the SDE. For the case where we have one group of data, we employed one feed forward DNN as the discriminator, while for the case of multiple groups of data we employed multiple discriminators in PI-GANs. We solved forward, inverse, and mixed problems without changing the framework of PI-GANs, obtaining both the means and the standard deviations of the stochastic solution and the diffusion coefficient in good agreement with benchmarks. In this work, we have demonstrated the effectiveness of PI-GANs in solving SDEs for about 120 dimensions. In principle, PI-GANs could tackle very high dimensional problems given more sensor data with low-polynomial growth in computational cost.

GATSBI: Generative Adversarial Training for Simulation-Based Inference

Adversarial Bayesian Simulation

Generative AI for Bayesian Computation

Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimation

GATSBI: Generative Agent-centric Spatio-temporal Object Interaction

Generalized Posteriors in Approximate Bayesian Computation

Compositional simulation-based inference for time series

Active Sequential Posterior Estimation for Sample-Efficient Simulation-Based Inference

Monte Carlo simulation of SDEs using GANs

Stochastic Gradient Bayesian Optimal Experimental Designs for Simulation-based Inference

Fast, accurate and lightweight sequential simulation-based inference using Gaussian locally linear mappings

Iterative Construction of Gaussian Process Surrogate Models for Bayesian Inference

Training-image based geostatistical inversion using a spatial generative adversarial neural network

The efficacy and generalizability of conditional GANs for posterior inference in physics-based inverse problems

The informed sampler: A discriminative approach to Bayesian inference in generative computer vision models

Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations

GATS: Gather-Attend-Scatter

Learning in Implicit Generative Models

GAT-GMM: Generative Adversarial Training for Gaussian Mixture Models

A Comprehensive Guide to Simulation-based Inference in Computational Biology

Variational Autoencoders for Efficient Simulation-Based Inference