Abstract:We develop a new Bayesian framework based on deep neural networks to be able to extrapolate in space-time using historical data and to quantify uncertainties arising from both noisy and gappy data in physical problems. Specifically, the proposed approach has two stages: (1) prior learning and (2) posterior estimation. At the first stage, we employ the physics-informed Generative Adversarial Networks (PI-GAN) to learn a functional prior either from a prescribed function distribution, e.g., Gaussian process, or from historical data and physics. At the second stage, we employ the Hamiltonian Monte Carlo (HMC) method to estimate the posterior in the latent space of PI-GANs. In addition, we use two different approaches to encode the physics: (1) automatic differentiation, used in the physics-informed neural networks (PINNs) for scenarios with explicitly known partial differential equations (PDEs), and (2) operator regression using the deep operator network (DeepONet) for PDE-agnostic scenarios. We then test the proposed method for (1) meta-learning for one-dimensional regression, and forward/inverse PDE problems (combined with PINNs); (2) PDE-agnostic physical problems (combined with DeepONet), e.g., fractional diffusion as well as saturated stochastic (100-dimensional) flows in heterogeneous porous media; and (3) spatial-temporal regression problems, i.e., inference of a marine riser displacement field using experimental data from the Norwegian Deepwater Programme (NDP). The results demonstrate that the proposed approach can provide accurate predictions as well as uncertainty quantification given very limited scattered and noisy data, since historical data could be available to provide informative priors. In , the proposed method is capable of learning flexible functional priors, e.g., both Gaussian and non-Gaussian process, and can be readily extended to big data problems by enabling mini-batch training using stochastic HMC or normalizing flows since the latent space is generally characterized as low dimensional.

Physics-based linear regression for high-dimensional forward uncertainty quantification

A Surrogate Modelling Approach Based on Nonlinear Dimension Reduction for Uncertainty Quantification in Groundwater Flow Models

Fast Uncertainty Quantification by Sparse Data Learning from Multiphysics Systems

High-Dimensional Uncertainty Quantification in Multi-Physics Simulation for 3D Large-Scale High-Power Microwave System

A hybrid data driven-physics constrained Gaussian process regression framework with deep kernel for uncertainty quantification

3D multi-physics uncertainty quantification using physics-based machine learning

A physics and data co-driven surrogate modeling method for high-dimensional rare event simulation

Gaussian process regression + deep neural network autoencoder for probabilistic surrogate modeling in nonlinear mechanics of solids

Dimensionality reduction can be used as a surrogate model for high-dimensional forward uncertainty quantification

Physics-Informed Representation and Learning: Control and Risk Quantification

Physics-Constrained Learning for PDE Systems with Uncertainty Quantified Port-Hamiltonian Models

Physics-Informed Quantum Machine Learning: Solving nonlinear differential equations in latent spaces without costly grid evaluations

Physics Constrained Deep Learning For Turbulence Model Uncertainty Quantification

A Physics-Informed Gaussian Process Regression Algorithm for the Dynamics of the Planar Pendulum

Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantification

Physics-constrained polynomial chaos expansion for scientific machine learning and uncertainty quantification

Randomized Physics-Informed Machine Learning for Uncertainty Quantification in High-Dimensional Inverse Problems

Physics-informed machine learning as a kernel method

Physics-informed neural networks for solving forward and inverse problems in complex beam systems

Learning functional priors and posteriors from data and physics

Physics-informed kernel learning