Abstract:Physics-informed neural networks (PINNs) have recently emerged as an alternative way of numerically solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In particular, in addition to the deep neural network (DNN) for the solution, an auxiliary DNN is considered that represents the residual of the PDE. The residual is then combined with the mismatch in the given data of the solution in order to formulate the loss function. This framework is effective but is lacking uncertainty quantification of the solution due to the inherent randomness in the data or due to the approximation limitations of the DNN architecture. Here, we propose a new method with the objective of endowing the DNN with uncertainty quantification for both sources of uncertainty, i.e., the parametric uncertainty and the approximation uncertainty. We first account for the parametric uncertainty when the parameter in the differential equation is represented as a stochastic process. Multiple DNNs are designed to learn the modal functions of the arbitrary polynomial chaos (aPC) expansion of its solution by using stochastic data from sparse sensors. We can then make predictions from new sensor measurements very efficiently with the trained DNNs. Moreover, we employ dropout to quantify the uncertainty of DNNs in approximating the modal functions. We then design an active learning strategy based on the dropout uncertainty to place new sensors in the domain in order to improve the predictions of DNNs. Several numerical tests are conducted for both the forward and the inverse problems to demonstrate the effectiveness of PINNs combined with uncertainty quantification. This NN-aPC new paradigm of physics-informed deep learning with uncertainty quantification can be readily applied to other types of stochastic PDEs in multi-dimensions.

Effects of Key Factors on Uncertainty Quantifications in Full-wave Inverse Scattering Problems

Uncertainty Calibrations of Deep-Learning Schemes for Full-Wave Inverse Scattering Problems

Uncertainty Nonlinearly Guided Learning Framework for Full-Wave Inverse Scattering

Uncertainty Quantification in Inverse Scattering Problems With Bayesian Convolutional Neural Networks

High-Dimensional Uncertainty Quantification in Multi-Physics Simulation for 3D Large-Scale High-Power Microwave System

High-Dimensional Uncertainty Quantification for Radar Cross Section of Multi-Layered Dieletric Block

Physics-guided Loss Functions Improve Deep Learning Performance in Inverse Scattering

Generalization Capabilities Of Deep Learning Schemes In Solving Inverse Scattering Problems

A Reconstruction Method of Electromagnetic Scattering Target Based on Diffusion Model

Deep-Learning Schemes for Full-Wave Nonlinear Inverse Scattering Problems.

A Review of Deep Learning Approaches for Inverse Scattering Problems

Combining unsupervised deep learning and Monte Carlo dropout for seismic data reconstruction and its uncertainty quantification

On the Quantification of Image Reconstruction Uncertainty without Training Data

Probabilistic Deep Learning Solutions to Electromagnetic Inverse Scattering Problems Using Conditional Renormalization Group Flow

Physics Embedded Deep Neural Network for Solving Full-Wave Inverse Scattering Problems

Effects of Multiple Scattering on Resolution of Full-Wave Inverse-Scattering Solver

Deep Learning-Based Inversion Methods for Solving Inverse Scattering Problems With Phaseless Data

From Displacements to Distributions: A Machine-Learning Enabled Framework for Quantifying Uncertainties in Parameters of Computational Models

Study on Low-Frequency Data Learning for Inverse Scattering Problems with High Nonlinearity

Uncertainty Quantification in Intelligent-Based Electrical Resistivity Tomography Image Reconstruction With Monte Carlo Dropout Strategy

Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems