Abstract:Stochastic differential equations are commonly used to describe the evolution of stochastic processes. The uncertainty of such processes is best represented by the probability density function (PDF), whose evolution is governed by the Fokker-Planck partial differential equation (FP-PDE). However, it is generally infeasible to solve the FP-PDE in closed form. In this work, we show that physics-informed neural networks (PINNs) can be trained to approximate the solution PDF using existing methods. The main contribution is the analysis of the approximation error: we develop a theory to construct an arbitrary tight error bound with PINNs. In addition, we derive a practical error bound that can be efficiently constructed with existing training methods. Finally, we explain that this error-bound theory generalizes to approximate solutions of other linear PDEs. Several numerical experiments are conducted to demonstrate and validate the proposed methods.

What problem does this paper attempt to address?

The core problem that this paper attempts to solve is: **How to use physics - informed neural networks (PINNs) to approximate the probability density function (PDF) of stochastic differential equations (SDEs) and strictly quantify the error bounds of this approximation**. Specifically, the focus of the paper is as follows: 1. **Using PINNs to approximate the PDF of SDEs**: - Stochastic differential equations (SDEs) are usually used to describe the evolution of stochastic processes. The uncertainty of these processes can be represented by the probability density function (PDF), and the evolution of the PDF is controlled by the Fokker - Planck partial differential equation (FP - PDE). - Since directly solving the FP - PDE is infeasible in most cases, the paper proposes to use physics - informed neural networks (PINNs) to approximate the solution of the FP - PDE. 2. **Quantifying and strictly bounding the approximation error**: - The main contribution of the paper is to develop a theoretical method that can construct arbitrarily tight error bounds. This method is not limited to the FP - PDE and can also be generalized to the approximate solutions of other linear partial differential equations (PDEs). - By introducing a series of recursive error functions and proving that only two PINNs need to be trained to obtain arbitrarily tight error bounds, the key problem of error quantification is solved. 3. **Providing practical error bounds**: - In order to improve the feasibility in practical applications, the paper also derives a more practical error bound. Although it does not have arbitrary tightness, it can be achieved by training only one PINN. ### Formula Summary - **Expression of FP - PDE**: \[ \frac{\partial p(x, t)}{\partial t}+\sum_{i = 1}^{n}\frac{\partial}{\partial x_i}[f_i p(x, t)]-\frac{1}{2}\sum_{i = 1}^{n}\sum_{j = 1}^{n}\frac{\partial^2}{\partial x_i\partial x_j}[\sum_{k = 1}^{m}g_{ik}g_{jk}p(x, t)] = 0 \] - **Definition of the error function**: \[ e(x, t):=p(x, t)-\hat{p}(x, t) \] - **Recursive PDE of the error function**: \[ D[e_i(x, t)]+D[\hat{e}_{i - 1}(x, t)] = 0\quad\text{subject to}\quad e_i(x, 0)=e_{i - 1}(x, 0)-\hat{e}_{i - 1}(x, 0) \] - **Error bound formula**: \[ |e(x, t)|\leq\hat{e}^*_1(t)\left(\frac{1}{1-\gamma_2^1(t)}\right) \] where \(\hat{e}^*_1(t)\) is the maximum value of \(\hat{e}_1(x, t)\) on \(X'\), and \(\gamma_2^1(t)=\frac{\hat{e}^*_2(t)}{\hat{e}^*_1(t)}\). ### Conclusion By introducing recursive error functions and strict mathematical analysis, the paper successfully solves the error quantification problem when using PINNs to approximate the PDF of SDEs. This not only provides a new tool for the uncertainty propagation of stochastic systems but also demonstrates its effectiveness in practical applications.

Error Bounds for Deep Learning-based Uncertainty Propagation in SDEs

Exact and approximate error bounds for physics-informed neural networks

Residual-based error bound for physics-informed neural networks

Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems

Error-Aware B-PINNs: Improving Uncertainty Quantification in Bayesian Physics-Informed Neural Networks

Bayesian Deep Learning Framework for Uncertainty Quantification in Stochastic Partial Differential Equations

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs

Error Analysis of Physics-Informed Neural Networks for Approximating Dynamic PDEs of Second Order in Time

Efficient Error Certification for Physics-Informed Neural Networks

Modelling parametric uncertainty in PDEs models via Physics-Informed Neural Networks

Evaluating Error Bound for Physics-Informed Neural Networks on Linear Dynamical Systems

SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimates

Surrogate-Based Physics-Informed Neural Networks for Elliptic Partial Differential Equations

Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker-Planck Equations

Deep fuzzy physics-informed neural networks for forward and inverse PDE problems

A principled distance-aware uncertainty quantification approach for enhancing the reliability of physics-informed neural network

Evaluating Uncertainty Quantification approaches for Neural PDEs in scientific applications

A deep learning approach to the probabilistic numerical solution of path-dependent partial differential equations

Recipes for when physics fails: recovering robust learning of physics informed neural networks

Physics-Informed Solution of The Stationary Fokker-Plank Equation for a Class of Nonlinear Dynamical Systems: An Evaluation Study

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks