Abstract:We develop a new Bayesian framework based on deep neural networks to be able to extrapolate in space-time using historical data and to quantify uncertainties arising from both noisy and gappy data in physical problems. Specifically, the proposed approach has two stages: (1) prior learning and (2) posterior estimation. At the first stage, we employ the physics-informed Generative Adversarial Networks (PI-GAN) to learn a functional prior either from a prescribed function distribution, e.g., Gaussian process, or from historical data and physics. At the second stage, we employ the Hamiltonian Monte Carlo (HMC) method to estimate the posterior in the latent space of PI-GANs. In addition, we use two different approaches to encode the physics: (1) automatic differentiation, used in the physics-informed neural networks (PINNs) for scenarios with explicitly known partial differential equations (PDEs), and (2) operator regression using the deep operator network (DeepONet) for PDE-agnostic scenarios. We then test the proposed method for (1) meta-learning for one-dimensional regression, and forward/inverse PDE problems (combined with PINNs); (2) PDE-agnostic physical problems (combined with DeepONet), e.g., fractional diffusion as well as saturated stochastic (100-dimensional) flows in heterogeneous porous media; and (3) spatial-temporal regression problems, i.e., inference of a marine riser displacement field using experimental data from the Norwegian Deepwater Programme (NDP). The results demonstrate that the proposed approach can provide accurate predictions as well as uncertainty quantification given very limited scattered and noisy data, since historical data could be available to provide informative priors. In , the proposed method is capable of learning flexible functional priors, e.g., both Gaussian and non-Gaussian process, and can be readily extended to big data problems by enabling mini-batch training using stochastic HMC or normalizing flows since the latent space is generally characterized as low dimensional.

Physics-informed semantic inpainting: Application to geostatistical modeling

Including Physics in Deep Learning -- An example from 4D seismic pressure saturation inversion

SePaint: Semantic Map Inpainting via Multinomial Diffusion

Boosted GAN with Semantically Interpretable Information for Image Inpainting

MMGInpainting: Multi-Modality Guided Image Inpainting Based On Diffusion Models

Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications

Physics-driven generative adversarial networks empower single-pixel infrared hyperspectral imaging

Generative Memory-Guided Semantic Reasoning Model for Image Inpainting

Physics-informed machine learning

Fully Context-Aware Image Inpainting with a Learned Semantic Pyramid

Physics-informed neural networks in the recreation of hydrodynamic simulations from dark matter

Learning functional priors and posteriors from data and physics

Deep Generative Network for Image Inpainting with Gradient Semantics and Spatial-Smooth Attention

HSI-IPGAN: Hyperspectral Image Inpainting via Generative Adversarial Network

Physics-Based Generative Adversarial Models for Image Restoration and Beyond

Semantic Image Inpainting with Progressive Generative Networks.

Probabilistic Semantic Inpainting with Pixel Constrained CNNs

Both Spatial and Frequency Cues Contribute to High-Fidelity Image Inpainting

Physics-informed ConvNet: Learning Physical Field from a Shallow Neural Network

Physics-informed and graph neural networks for enhanced inverse analysis

Optimized segmentation with image inpainting for semantic mapping in dynamic scenes