Abstract:We develop a new Bayesian framework based on deep neural networks to be able to extrapolate in space-time using historical data and to quantify uncertainties arising from both noisy and gappy data in physical problems. Specifically, the proposed approach has two stages: (1) prior learning and (2) posterior estimation. At the first stage, we employ the physics-informed Generative Adversarial Networks (PI-GAN) to learn a functional prior either from a prescribed function distribution, e.g., Gaussian process, or from historical data and physics. At the second stage, we employ the Hamiltonian Monte Carlo (HMC) method to estimate the posterior in the latent space of PI-GANs. In addition, we use two different approaches to encode the physics: (1) automatic differentiation, used in the physics-informed neural networks (PINNs) for scenarios with explicitly known partial differential equations (PDEs), and (2) operator regression using the deep operator network (DeepONet) for PDE-agnostic scenarios. We then test the proposed method for (1) meta-learning for one-dimensional regression, and forward/inverse PDE problems (combined with PINNs); (2) PDE-agnostic physical problems (combined with DeepONet), e.g., fractional diffusion as well as saturated stochastic (100-dimensional) flows in heterogeneous porous media; and (3) spatial-temporal regression problems, i.e., inference of a marine riser displacement field using experimental data from the Norwegian Deepwater Programme (NDP). The results demonstrate that the proposed approach can provide accurate predictions as well as uncertainty quantification given very limited scattered and noisy data, since historical data could be available to provide informative priors. In , the proposed method is capable of learning flexible functional priors, e.g., both Gaussian and non-Gaussian process, and can be readily extended to big data problems by enabling mini-batch training using stochastic HMC or normalizing flows since the latent space is generally characterized as low dimensional.

Data Imputation with Uncertainty Using Stochastic Physics-Informed Learning

Probabilistic Individual Load Forecasting Using Pinball Loss Guided LSTM

Stochastic physics-informed neural ordinary differential equations

Regularised Learning with Selected Physics for Power System Dynamics

Low-Dimensional ODE Embedding to Convert Low-Resolution Meters into “virtual” PMUs

Nonparametric Stochastic Differential Equations for Ultra-Short-Term Probabilistic Forecasting of Wind Power Generation

Generalizable Physics-Informed Learning for Stochastic Safety-Critical Systems

Physics-Informed AI Surrogates for Day-Ahead Wind Power Probabilistic Forecasting with Incomplete Data for Smart Grid in Smart Cities

Learning functional priors and posteriors from data and physics

Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty

Robust Regression with Highly Corrupted Data via Physics Informed Neural Networks

Physics-informed learning of governing equations from scarce data

Learning from Integral Losses in Physics Informed Neural Networks

Spatio-temporal DeepKriging for Interpolation and Probabilistic Forecasting

Data-driven method to learn the most probable transition pathway and stochastic differential equation

A Novel Hybrid Method for Short-Term Probabilistic Load Forecasting in Distribution Networks

Data-driven method to learn the most probable transition pathway and stochastic differential equations

Randomized Physics-Informed Neural Networks for Bayesian Data Assimilation

Data-driven Stochastic Model Predictive Control Method for Voltage and Power Regulation in Active Distribution Networks

Physics-informed deep learning: A promising technique for system reliability assessment

A Stabilized Physics Informed Neural Networks Method for Wave Equations