Abstract:We developed a new class of physics-informed generative adversarial networks (PI-GANs) to solve forward, inverse, and mixed stochastic problems in a unified manner based on a limited number of scattered measurements. Unlike standard GANs relying solely on data for training, here we encoded into the architecture of GANs the governing physical laws in the form of stochastic differential equations (SDEs) using automatic differentiation. In particular, we applied Wasserstein GANs with gradient penalty (WGAN-GP) for its enhanced stability compared to vanilla GANs. We first tested WGAN-GP in approximating Gaussian processes of different correlation lengths based on data realizations collected from simultaneous reads at sparsely placed sensors. We obtained good approximation of the generated stochastic processes to the target ones even if there is a mismatch between the input noise dimensionality and the effective dimensionality of the target stochastic processes. We also studied the overfitting issue for both the discriminator and the generator, and we found that overfitting occurs also in the generator in addition to the discriminator as previously reported. Subsequently, we considered the solution of elliptic SDEs requiring approximations of three stochastic processes, namely the solution, the forcing, and the diffusion coefficient. Here again, we assumed data collected from simultaneous reads at a limited number of sensors for the multiple stochastic processes. Three generators were used for the PI-GANs: two of them were feed forward deep neural networks (DNNs), while the other one was the neural network induced by the SDE. For the case where we have one group of data, we employed one feed forward DNN as the discriminator, while for the case of multiple groups of data we employed multiple discriminators in PI-GANs. We solved forward, inverse, and mixed problems without changing the framework of PI-GANs, obtaining both the means and the standard deviations of the stochastic solution and the diffusion coefficient in good agreement with benchmarks. In this work, we have demonstrated the effectiveness of PI-GANs in solving SDEs for about 120 dimensions. In principle, PI-GANs could tackle very high dimensional problems given more sensor data with low-polynomial growth in computational cost.

Generative Ensemble Regression: Learning Particle Dynamics from Observations of Ensembles with Physics-informed Deep Generative Models

Generative Learning With Euler Particle Transport

Stochastic physics-informed neural ordinary differential equations

Learning to Approximate Particle Smoothing Trajectories via Diffusion Generative Models

Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty

Physics-informed generator-encoder adversarial networks with latent space matching for stochastic differential equations

Generative learning for forecasting the dynamics of high-dimensional complex systems

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning.

Physics-informed learning of governing equations from scarce data

Encoding physics to learn reaction–diffusion processes

Learning effective stochastic differential equations from microscopic simulations: combining stochastic numerics and deep learning

Unifying Predictions of Deterministic and Stochastic Physics in Mesh-reduced Space with Sequential Flow Generative Model

Towards Complex Dynamic Physics System Simulation with Graph Neural ODEs

Physics-aware, probabilistic model order reduction with guaranteed stability

Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations

Towards complex dynamic physics system simulation with graph neural ordinary equations

Identifying Drift, Diffusion, and Causal Structure from Temporal Snapshots

Estimation of spatial and time scales of collective behaviors of active matters through learning hydrodynamic equations from particle dynamics

Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems

Data-driven Discovery of Emergent Behaviors in Collective Dynamics