Abstract:We develop a new Bayesian framework based on deep neural networks to be able to extrapolate in space-time using historical data and to quantify uncertainties arising from both noisy and gappy data in physical problems. Specifically, the proposed approach has two stages: (1) prior learning and (2) posterior estimation. At the first stage, we employ the physics-informed Generative Adversarial Networks (PI-GAN) to learn a functional prior either from a prescribed function distribution, e.g., Gaussian process, or from historical data and physics. At the second stage, we employ the Hamiltonian Monte Carlo (HMC) method to estimate the posterior in the latent space of PI-GANs. In addition, we use two different approaches to encode the physics: (1) automatic differentiation, used in the physics-informed neural networks (PINNs) for scenarios with explicitly known partial differential equations (PDEs), and (2) operator regression using the deep operator network (DeepONet) for PDE-agnostic scenarios. We then test the proposed method for (1) meta-learning for one-dimensional regression, and forward/inverse PDE problems (combined with PINNs); (2) PDE-agnostic physical problems (combined with DeepONet), e.g., fractional diffusion as well as saturated stochastic (100-dimensional) flows in heterogeneous porous media; and (3) spatial-temporal regression problems, i.e., inference of a marine riser displacement field using experimental data from the Norwegian Deepwater Programme (NDP). The results demonstrate that the proposed approach can provide accurate predictions as well as uncertainty quantification given very limited scattered and noisy data, since historical data could be available to provide informative priors. In , the proposed method is capable of learning flexible functional priors, e.g., both Gaussian and non-Gaussian process, and can be readily extended to big data problems by enabling mini-batch training using stochastic HMC or normalizing flows since the latent space is generally characterized as low dimensional.

Causal prior-embedded physics-informed neural networks and a case study on metformin transport in porous media

Learning functional priors and posteriors from data and physics

Causality and Bayesian network PDEs for multiscale representations of porous media

Surrogate Modeling for Porous Flow Using Deep Neural Networks

Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transport

A causal intervention framework for synthesizing mobility data and evaluating predictive neural networks

A deep causal inference model for fully-interpretable travel behaviour analysis

Experimental and AI-based numerical modeling of contaminant transport in porous media

Causally-informed deep learning to improve climate models and projections

Explicit physics-informed neural networks for non-linear upscaling closure: the case of transport in tissues

Optimal transport for causal discovery

Deep autoregressive neural networks for high-dimensional inverse problems in groundwater contaminant source identification

Bayesian-Based Causal Structure Inference With a Domain Knowledge Prior for Stable and Interpretable Soft Sensing

Markov chain Monte Carlo with neural network surrogates: application to contaminant source identification

pg-Causality: Identifying Spatiotemporal Causal Pathways for Air Pollutants with Urban Big Data

Stochastic analysis of heterogeneous porous material with modified neural architecture search (NAS) based physics-informed neural networks using transfer learning

Solving multiphysics-based inverse problems with learned surrogates and constraints

Neural Network-Based Hybrid Modeling Approach Incorporating Bayesian Optimization with Industrial Soft Sensor Application

A Gaussian Bayesian Model to Identify Spatio-Temporal Causalities for Air Pollution Based on Urban Big Data

Causality-guided adaptive sampling method for physics-informed neural networks

Physics Informed Deep Learning for Flow and Transport in Porous Media