Abstract:Physics-informed neural networks (PINNs) have recently emerged as an alternative way of numerically solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In particular, in addition to the deep neural network (DNN) for the solution, an auxiliary DNN is considered that represents the residual of the PDE. The residual is then combined with the mismatch in the given data of the solution in order to formulate the loss function. This framework is effective but is lacking uncertainty quantification of the solution due to the inherent randomness in the data or due to the approximation limitations of the DNN architecture. Here, we propose a new method with the objective of endowing the DNN with uncertainty quantification for both sources of uncertainty, i.e., the parametric uncertainty and the approximation uncertainty. We first account for the parametric uncertainty when the parameter in the differential equation is represented as a stochastic process. Multiple DNNs are designed to learn the modal functions of the arbitrary polynomial chaos (aPC) expansion of its solution by using stochastic data from sparse sensors. We can then make predictions from new sensor measurements very efficiently with the trained DNNs. Moreover, we employ dropout to quantify the uncertainty of DNNs in approximating the modal functions. We then design an active learning strategy based on the dropout uncertainty to place new sensors in the domain in order to improve the predictions of DNNs. Several numerical tests are conducted for both the forward and the inverse problems to demonstrate the effectiveness of PINNs combined with uncertainty quantification. This NN-aPC new paradigm of physics-informed deep learning with uncertainty quantification can be readily applied to other types of stochastic PDEs in multi-dimensions.

Uncertainty Quantification in Inverse Scattering Problems With Bayesian Convolutional Neural Networks

Uncertainty Calibrations of Deep-Learning Schemes for Full-Wave Inverse Scattering Problems

Bayesian Inference and Deep Learning for Inverse Problems

Effects of Key Factors on Uncertainty Quantifications in Full-wave Inverse Scattering Problems

Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems

Uncertainty Nonlinearly Guided Learning Framework for Full-Wave Inverse Scattering

A Comprehensive Study of Calibration and Uncertainty Quantification for Bayesian Convolutional Neural Networks - An Application to Seismic Data

Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification

Calibration and Uncertainty Quantification of Bayesian Convolutional Neural Networks for Geophysical Applications

Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation

Bayesian Deep Learning Framework for Uncertainty Quantification in Stochastic Partial Differential Equations

Deep-Learning Schemes for Full-Wave Nonlinear Inverse Scattering Problems.

A Survey on Uncertainty Quantification Methods for Deep Learning

Leveraging the Bhattacharyya coefficient for uncertainty quantification in deep neural networks

Uncertainty Quantification for Deep Learning

Evaluating Uncertainty Quantification approaches for Neural PDEs in scientific applications

Fast uncertainty quantification of reservoir simulation with variational U-Net

An E-PINN assisted practical uncertainty quantification for inverse problems

Denoising Score-Matching for Uncertainty Quantification in Inverse Problems

Uncertainty Quantification for Sparse Deep Learning

Cycle Consistency-based Uncertainty Quantification of Neural Networks in Inverse Imaging Problems