Abstract:We provide an a priori analysis of a certain class of numerical methods, commonly referred to as collocation methods, for solving elliptic boundary value problems. They begin with information in the form of point values of the right side f of such equations and point values of the boundary function g and utilize only this information to numerically approximate the solution u of the Partial Differential Equation (PDE). For such a method to provide an approximation to u with guaranteed error bounds, additional assumptions on f and g, called model class assumptions, are needed. We determine the best error (in the energy norm) of approximating u, in terms of the number of point samples m, under all Besov class model assumptions for the right hand side $f$ and boundary g. We then turn to the study of numerical procedures and asks whether a proposed numerical procedure (nearly) achieves the optimal recovery error. We analyze numerical methods which generate the numerical approximation to $u$ by minimizing a specified data driven loss function over a set $\Sigma$ which is either a finite dimensional linear space, or more generally, a finite dimensional manifold. We show that the success of such a procedure depends critically on choosing a correct data driven loss function that is consistent with the PDE and provides sharp error control. Based on this analysis a loss function $L^*$ is proposed. We also address the recent methods of Physics Informed Neural Networks (PINNs). Minimization of the new loss $L^*$ over neural network spaces $\Sigma$ is referred to as consistent PINNs (CPINNs). We prove that CPINNs provides an optimal recovery of the solution $u$, provided that the optimization problem can be numerically executed and $\Sigma$ has sufficient approximation capabilities. Finally, numerical examples illustrating the benefits of the CPINNs are given.

Convergence Analysis for the PINNs

A Rate of Convergence of Physics Informed Neural Networks for the Linear Second Order Elliptic PDEs

Convergence and error analysis of PINNs

Convergence and error control of consistent PINNs for elliptic PDEs

Convergence of physics-informed neural networks applied to linear second-order elliptic interface problems

Improved Analysis of PINNs: Alleviate the CoD for Compositional Solutions

Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equations

Error Analysis and Numerical Algorithm for PDE Approximation with Hidden-Layer Concatenated Physics Informed Neural Networks

Generalization of PINNs for elliptic interface problems

Robust error estimates of PINN in one-dimensional boundary value problems for linear elliptic equations

Error Analysis of Physics-Informed Neural Networks for Approximating Dynamic PDEs of Second Order in Time

Investigating the Ability of PINNs To Solve Burgers' PDE Near Finite-Time BlowUp

Convergence Rate Analysis for Deep Ritz Method

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

Beyond Derivative Pathology of PINNs: Variable Splitting Strategy with Convergence Analysis

Generalized conditional symmetry enhanced physics-informed neural network and application to the forward and inverse problems of nonlinear diffusion equations

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs

On the estimation rate of Bayesian PINN for inverse problems

Physics-informed neural networks with parameter asymptotic strategy for learning singularly perturbed convection-dominated problem

Binary structured physics-informed neural networks for solving equations with rapidly changing solutions