Abstract:We provide an a priori analysis of a certain class of numerical methods, commonly referred to as collocation methods, for solving elliptic boundary value problems. They begin with information in the form of point values of the right side f of such equations and point values of the boundary function g and utilize only this information to numerically approximate the solution u of the Partial Differential Equation (PDE). For such a method to provide an approximation to u with guaranteed error bounds, additional assumptions on f and g, called model class assumptions, are needed. We determine the best error (in the energy norm) of approximating u, in terms of the number of point samples m, under all Besov class model assumptions for the right hand side $f$ and boundary g. We then turn to the study of numerical procedures and asks whether a proposed numerical procedure (nearly) achieves the optimal recovery error. We analyze numerical methods which generate the numerical approximation to $u$ by minimizing a specified data driven loss function over a set $\Sigma$ which is either a finite dimensional linear space, or more generally, a finite dimensional manifold. We show that the success of such a procedure depends critically on choosing a correct data driven loss function that is consistent with the PDE and provides sharp error control. Based on this analysis a loss function $L^*$ is proposed. We also address the recent methods of Physics Informed Neural Networks (PINNs). Minimization of the new loss $L^*$ over neural network spaces $\Sigma$ is referred to as consistent PINNs (CPINNs). We prove that CPINNs provides an optimal recovery of the solution $u$, provided that the optimization problem can be numerically executed and $\Sigma$ has sufficient approximation capabilities. Finally, numerical examples illustrating the benefits of the CPINNs are given.

A Rate of Convergence of Physics Informed Neural Networks for the Linear Second Order Elliptic PDEs

Convergence Analysis for the PINNs

Convergence of physics-informed neural networks applied to linear second-order elliptic interface problems

Convergence and error analysis of PINNs

Error Analysis of Physics-Informed Neural Networks for Approximating Dynamic PDEs of Second Order in Time

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

Generalization of PINNs for elliptic interface problems

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equations

On the Compatibility between Neural Networks and Partial Differential Equations for Physics-informed Learning

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs

Convergence and error control of consistent PINNs for elliptic PDEs

Efficient Error Certification for Physics-Informed Neural Networks

Higher-order error estimates for physics-informed neural networks approximating the primitive equations

Improved Analysis of PINNs: Alleviate the CoD for Compositional Solutions

A Priori Error Estimation of Physics-Informed Neural Networks Solving Allen--Cahn and Cahn--Hilliard Equations

On the estimation rate of Bayesian PINN for inverse problems

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating a class of inverse problems for PDEs

Error Analysis and Numerical Algorithm for PDE Approximation with Hidden-Layer Concatenated Physics Informed Neural Networks

A Unified Framework for the Error Analysis of Physics-Informed Neural Networks

Robust error estimates of PINN in one-dimensional boundary value problems for linear elliptic equations