Abstract:Physics-Informed Neural Networks (PINNs) are gaining popularity as a method for solving differential equations. While being more feasible in some contexts than the classical numerical techniques, PINNs still lack credibility. A remedy for that can be found in Uncertainty Quantification (UQ) which is just beginning to emerge in the context of PINNs. Assessing how well the trained PINN complies with imposed differential equation is the key to tackling uncertainty, yet there is lack of comprehensive methodology for this task. We propose a framework for UQ in Bayesian PINNs (B-PINNs) that incorporates the discrepancy between the B-PINN solution and the unknown true solution. We exploit recent results on error bounds for PINNs on linear dynamical systems and demonstrate the predictive uncertainty on a class of linear ODEs.
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is **to improve the uncertainty quantification (UQ) ability in Bayesian physics - informed neural networks (B - PINNs)**. Specifically, the author points out that although current PINNs and B - PINNs perform well in solving differential equations, they still have deficiencies in handling uncertainty, especially lacking effective methods in evaluating the degree of the model's compliance with physical equations.
### Main contributions of the paper include:
1. **Analysis of the limitations of existing B - PINNs**: Through theoretical and empirical analysis, the author points out that the existing B - PINNs framework lacks the necessary components to incorporate uncertainties related to physical equations.
2. **Introduction of the concept of Error - Aware B - PINNs**: In order to improve uncertainty quantification, the author proposes a new framework - Error - Aware B - PINNs, which more accurately captures the uncertainty in prediction by introducing pseudo - aleatoric uncertainty.
3. **Verification on specific problems**: The author conducts experiments on a class of linear dynamical systems, showing how to strictly model pseudo - aleatoric uncertainty and proving the effectiveness of the new method.
### Specific problem description:
As mentioned in the paper, the existing B - PINNs methods have the following problems in handling uncertainty:
- **Insufficient consideration of the compliance with physical equations**: The existing B - PINNs methods mainly rely on data noise to estimate uncertainty, ignoring the degree of the model's compliance with physical equations.
- **Confusion of uncertainty sources**: Since multiple uncertainty sources (such as data noise, model architecture, etc.) are mixed together, it is difficult to distinguish the influence of different sources on uncertainty.
To solve these problems, the author proposes **Error - Aware B - PINNs**, whose core idea is to quantify the degree of the model's compliance with physical equations by introducing pseudo - aleatoric uncertainty. Pseudo - aleatoric uncertainty does not come from the data itself, but from the error of the PINN model with respect to the physical equation.
### Mathematical expression:
Suppose we have a linear dynamical system, and its error bound can be expressed as:
\[
|u(x) - u_{\theta}(x)| \leq e^{-\lambda x} \int_{x_{0}}^{x} e^{\lambda \xi} |r_{MSE}(\xi)| d\xi
\]
where \( r_{MSE}(x) \) is the residual network of the PINN trained with mean - squared error (MSE), and \( \lambda \) is the parameter of the system. Based on this error bound, the author defines the pseudo - random variance \( \sigma_{P}(x) \):
\[
\sigma_{P}(x)=E[r_{MSE}(x), \lambda]=e^{-\lambda x} \int_{x_{0}}^{x} e^{\lambda \xi} |r_{MSE}(\xi)| d\xi
\]
In this way, the author can more accurately capture the degree of the model's compliance with physical equations and incorporate it into uncertainty quantification.
### Summary:
This paper aims to improve the uncertainty quantification in Bayesian physics - informed neural networks by introducing Error - Aware B - PINNs, especially in dealing with the compliance with physical equations. This not only improves the reliability of the model, but also provides better guarantees for the future deployment of deep - learning models in safety - critical applications.