Abstract:Data-driven discovery of governing equations in computational science has emerged as a new paradigm for obtaining accurate physical models and as a possible alternative to theoretical derivations. The recently developed physics-informed neural networks (PINNs) have also been employed to learn governing equations given data across diverse scientific disciplines, e.g., in biology and fluid dynamics. Despite the effectiveness of PINNs for discovering governing equations, the physical models encoded in PINNs may be misspecified in complex systems as some of the physical processes may not be fully understood, leading to the poor accuracy of PINN predictions. In this work, we present a general approach to correct the misspecified physical models in PINNs for discovering governing equations, given some sparse and/or noisy data. Specifically, we first encode the assumed physical models, which may be misspecified in PINNs, and then employ other deep neural networks (DNNs) to model the discrepancy between the imperfect models and the observational data. Due to the expressivity of DNNs, the proposed method is capable of reducing the computational errors caused by the model misspecification and thus enables the applications of PINNs in complex systems where the physical processes are not exactly known. Furthermore, we utilize the Bayesian physics-informed neural networks (B-PINNs) and/or ensemble PINNs to quantify uncertainties arising from noisy and/or gappy data in the discovered governing equations. A series of numerical examples including reaction-diffusion systems and non-Newtonian channel and cavity flows demonstrate that the added DNNs are capable of correcting the model misspecification in PINNs and thus reduce the discrepancy between the physical models encoded in PINNs and the observational data. In addition, the B-PINNs and ensemble PINNs can provide reasonable uncertainty bounds in the discovered physical models, which makes the predictions more reliable. We also demonstrate that we can seamlessly combine the present approach with the symbolic regression to obtain the explicit governing equations upon the training of PINNs. We envision that the proposed approach will extend the applications of PINNs for discovering governing equations in problems where the physico-chemical or biological processes are not well understood.

Numerical analysis of physics-informed neural networks and related models in physics-informed machine learning

Machine Learning Through Physics–Informed Neural Networks: Progress and Challenges

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs

Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What's Next

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating a class of inverse problems for PDEs

Convergence and error analysis of PINNs

A Review of Physics Informed Neural Networks for Multiscale Analysis and Inverse Problems

From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learning

A Unified Framework for the Error Analysis of Physics-Informed Neural Networks

Physics-informed neural networks (PINNs) for numerical model error approximation and superresolution

Recipes for when physics fails: recovering robust learning of physics informed neural networks

Error Analysis of Physics-Informed Neural Networks for Approximating Dynamic PDEs of Second Order in Time

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

NeuralPDE: Automating Physics-Informed Neural Networks (PINNs) with Error Approximations

Characterizing possible failure modes in physics-informed neural networks

Physics-informed Neural Networks (PINN) for computational solid mechanics: Numerical frameworks and applications

A novel discretized physics-informed neural network model applied to the Navier-Stokes equations

Physics-informed Neural Networks for Elliptic Partial Differential Equations on 3D Manifolds

Critical Investigation of Failure Modes in Physics-informed Neural Networks

Correcting model misspecification in physics-informed neural networks (PINNs)

Understanding Physics-Informed Neural Networks: Techniques, Applications, Trends, and Challenges