Abstract:Physics-informed neural networks (PINNs) have recently emerged as an alternative way of numerically solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In particular, in addition to the deep neural network (DNN) for the solution, an auxiliary DNN is considered that represents the residual of the PDE. The residual is then combined with the mismatch in the given data of the solution in order to formulate the loss function. This framework is effective but is lacking uncertainty quantification of the solution due to the inherent randomness in the data or due to the approximation limitations of the DNN architecture. Here, we propose a new method with the objective of endowing the DNN with uncertainty quantification for both sources of uncertainty, i.e., the parametric uncertainty and the approximation uncertainty. We first account for the parametric uncertainty when the parameter in the differential equation is represented as a stochastic process. Multiple DNNs are designed to learn the modal functions of the arbitrary polynomial chaos (aPC) expansion of its solution by using stochastic data from sparse sensors. We can then make predictions from new sensor measurements very efficiently with the trained DNNs. Moreover, we employ dropout to quantify the uncertainty of DNNs in approximating the modal functions. We then design an active learning strategy based on the dropout uncertainty to place new sensors in the domain in order to improve the predictions of DNNs. Several numerical tests are conducted for both the forward and the inverse problems to demonstrate the effectiveness of PINNs combined with uncertainty quantification. This NN-aPC new paradigm of physics-informed deep learning with uncertainty quantification can be readily applied to other types of stochastic PDEs in multi-dimensions.

Computation of the Time-Dependent Dirac Equation with Physics-Informed Neural Networks

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

Physics-Informed Neural Networks as Solvers for the Time-Dependent Schrödinger Equation

Learning Physics-Informed Neural Networks without Stacked Back-propagation

Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

Machine Learning Through Physics–Informed Neural Networks: Progress and Challenges

Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What's Next

DAL-PINNs: Physics-informed Neural Networks Based on D'Alembert Principle for Generalized Electromagnetic Field Model Computation

Chebyshev spectral approximation-based physics-informed neural network for solving higher-order nonlinear differential equations

Advanced Physics-Informed Neural Networks for Numerical Approximation of the Coupled Schrödinger-Kdv Equation

PinnDE: Physics-Informed Neural Networks for Solving Differential Equations

Physics-informed neural networks viewpoint for solving the Dyson-Schwinger equations of quantum electrodynamics

Coupled Physics-informed Neural Networks for Inferring Solutions of Partial Differential Equations with Unknown Source Terms

Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems

An Efficient Framework for Solving Forward and Inverse Problems of Nonlinear Partial Differential Equations Via Enhanced Physics-Informed Neural Network Based on Adaptive Learning

PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networks

Physics-Informed Neural Networks for Time-Domain Simulations: Accuracy, Computational Cost, and Flexibility

Fourier Domain Physics Informed Neural Network

Functional Tensor Decompositions for Physics-Informed Neural Networks

Optimization of Physics-Informed Neural Networks for Solving the Nolinear Schrödinger Equation