Abstract:Physics-informed neural networks (PINNs) leverage neural-networks to find the solutions of partial differential equation (PDE)-constrained optimization problems with initial conditions and boundary conditions as soft constraints. These soft constraints are often considered to be the sources of the complexity in the training phase of PINNs. Here, we demonstrate that the challenge of training (i) persists even when the boundary conditions are strictly enforced, and (ii) is closely related to the Kolmogorov n-width associated with problems demonstrating transport, convection, traveling waves, or moving fronts. Given this realization, we describe the mechanism underlying the training schemes such as those used in eXtended PINNs (XPINN), curriculum regularization, and sequence-to-sequence learning. For an important category of PDEs, i.e., governed by non-linear convection-diffusion equation, we propose reformulating PINNs on a Lagrangian frame of reference, i.e., LPINNs, as a PDE-informed solution. A parallel architecture with two branches is proposed. One branch solves for the state variables on the characteristics, and the second branch solves for the low-dimensional characteristics curves. The proposed architecture conforms to the causality innate to the convection, and leverages the direction of travel of the information in the domain. Finally, we demonstrate that the loss landscapes of LPINNs are less sensitive to the so-called "complexity" of the problems, compared to those in the traditional PINNs in the Eulerian framework.

Generalization of PINNs for elliptic interface problems

A Rate of Convergence of Physics Informed Neural Networks for the Linear Second Order Elliptic PDEs

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs

Convergence of physics-informed neural networks applied to linear second-order elliptic interface problems

Convergence Analysis for the PINNs

Physics-informed Neural Networks for Elliptic Partial Differential Equations on 3D Manifolds

Robust error estimates of PINN in one-dimensional boundary value problems for linear elliptic equations

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating a class of inverse problems for PDEs

Refined generalization analysis of the Deep Ritz Method and Physics-Informed Neural Networks

Higher-order error estimates for physics-informed neural networks approximating the primitive equations

Convergence and error analysis of PINNs

On the Compatibility between Neural Networks and Partial Differential Equations for Physics-informed Learning

On the Generalization of PINNs outside the training domain and the Hyperparameters influencing it

Understanding the Difficulty of Solving Cauchy Problems with PINNs

Solving PDEs on Spheres with Physics-Informed Convolutional Neural Networks

Theory-guided physics-informed neural networks for boundary layer problems with singular perturbation

Lagrangian PINNs: A causality-conforming solution to failure modes of physics-informed neural networks

The Hard-Constraint PINNs for Interface Optimal Control Problems

General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations