Abstract:In this paper, we numerically examine the challenges that emerge in numerical integration for various tasks now tackled by physics-informed neural networks. Specifically, we illustrate how inaccurately computed integrands can cause serious precision issues. A major difficulty lies in detecting these problems, since a simple large-scale view of the integrand may not reveal any potential errors, and the resulting outcomes are often mistakenly considered correct. To address this, it is critical to determine whether standard double-precision arithmetic suffices for evaluating the integrand or if higher precision is necessary. We evaluate and suggest numerical quadrature methods for selected examples and parameter values, particularly focusing on challenging scenarios.

What problem does this paper attempt to address?

This paper attempts to address the challenges encountered in numerical integration in the modeling of Physics - Informed Neural Networks (PINNs). Specifically, the article explores the accuracy issues in numerical integration and their impact on PINNs training. ### Main Problems 1. **Inaccuracy of Numerical Integration**: - The article points out that in some cases, the inaccuracy of the calculated integrand can lead to serious accuracy problems. - These problems are difficult to detect because, from a large - scale perspective, the integrand may not show any potential errors, resulting in the results being misidentified as correct. 2. **Limitations of Floating - Point Arithmetic**: - Standard double - precision floating - point arithmetic (64 - bit floating - point numbers under the IEEE - 754 standard) is not always sufficient in many mathematical models. - For certain model parameters, many numerical integration algorithms cannot meet the requirements of high accuracy and low computation time, leading to a significant increase in the number of function evaluations, a serious decline in accuracy, and a significant increase in computation time. 3. **Selection of Numerical Integration Methods**: - To address these problems, the article evaluates and recommends using variable - precision or high - precision arithmetic for numerical integration. - Especially when dealing with complex integration tasks, such as inverse Fourier transform integration and integration of quartic polynomial functions, standard numerical integration methods may fail. ### Solutions 1. **High - Precision or Variable - Precision Arithmetic**: - Use high - precision or variable - precision arithmetic (such as the `vpa` function in MATLAB) to improve the accuracy of numerical integration. - This method can ensure obtaining correct integration results in complex models, thereby ensuring the accuracy of PINNs training. 2. **Adaptive Numerical Integration Methods**: - Use adaptive numerical integration methods (such as the adaptive Gaussian quadrature method) to handle different types of integration tasks. - These methods can automatically adjust the integration step size according to the characteristics of the integrand to improve computational efficiency and accuracy. ### Experimental Verification The article verifies the effectiveness of the above - mentioned methods through multiple experiments, including: - **Inverse Fourier Transform Integration**: An example in financial mathematics is presented, where the accurate evaluation of the integrand is crucial. - **Integration of Quartic Polynomial Functions**: Through a simple quartic polynomial function, it is illustrated that even very simple functions may cause serious problems in numerical integration. - **Heat Equation Problem**: It is studied how the initial value condition of a one - dimensional heat equation being an inaccurately evaluated function affects the analytical and numerical solutions. ### Conclusion The article emphasizes the importance of numerical integration in PINNs modeling and proposes using high - precision or variable - precision arithmetic to overcome the limitations of floating - point arithmetic and ensure the accuracy and reliability of numerical integration. This not only helps to improve the training effect of PINNs but also provides a valuable reference for other fields requiring high - precision numerical calculations. --- If you have more specific questions or need further explanation, please feel free to let me know!

Challenges in numerical integration in physics-informed neural networks modelling

Numerical analysis of physics-informed neural networks and related models in physics-informed machine learning

Adaptive quadratures for nonlinear approximation of low-dimensional PDEs using smooth neural networks

Learning from Integral Losses in Physics Informed Neural Networks

Integral Transforms in a Physics-Informed (Quantum) Neural Network setting: Applications & Use-Cases

Can Physics-Informed Neural Networks beat the Finite Element Method?

An Analysis of Physics-Informed Neural Networks

Bayesian Numerical Integration with Neural Networks

On quadrature rules for solving Partial Differential Equations using Neural Networks

PINNIES: An Efficient Physics-Informed Neural Network Framework to Integral Operator Problems

Error estimates for physics informed neural networks approximating the Navier-Stokes equations

Physics-informed neural networks (PINNs) for numerical model error approximation and superresolution

Understanding the Difficulty of Solving Cauchy Problems with PINNs

Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees

Learning Feynman integrals from differential equations with neural networks

Deep neural networks for smooth approximation of physics with higher order and continuity B-spline base functions

Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems