Abstract:Solving high-dimensional partial diﬀerential equations (PDEs) is a major challenge in scientiﬁc computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning. Our “Q-PDE” algorithm is mesh-free and therefore has the potential to overcome the curse of dimensionality. Using a neural tangent kernel (NTK) approach, we prove that the neural network approximator for the PDE solution, trained with the Q-PDE algorithm, converges to the trajectory of an inﬁnite-dimensional ordinary diﬀerential equation (ODE) as the number of hidden units → ∞ . For monotone PDE (i.e. those given by monotone operators, which may be nonlinear), despite the lack of a spectral gap in the NTK, we then prove that the limit neural network, which satisﬁes the inﬁnite-dimensional ODE, converges in L 2 to the PDE solution as the training time → ∞ . More generally, we can prove that any ﬁxed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition). The numerical performance of the Q-PDE algorithm is studied for several elliptic PDEs. this approach to study the performance of the biased gradient ﬂow as a training algorithm, and show that the wide-network limit satisﬁes an inﬁnite-dimensional ordinary diﬀerential equation (ODE).Weapply our Q-PDE approach to monotone PDEs, that is, where the diﬀerential operator satisﬁes a strong monotonicity condition. Monotone PDEs arise in various applications, particularly in PDEs arising from stochastic modeling – the generators of ergodic stochastic processes are monotone (when evaluated with their stationary distributions), which suggests a variety of possible applications of our approach. Further, the subdiﬀerentials of convex functionals (i.e. of maps from functions to the real line) are monotone; this suggests that monotone PDEs may be a particularly well-suited class of equations for gradient methods, as they correspond to (a generalization of) minimizations of convex functionals. We will see that, given this monotonicity assumption, we can prove that the limit Q-PDE algorithm will converge (strongly in L 2 ) to the solution of the monotone PDE. More generally, we can prove that any ﬁxed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition).

Some elliptic second order problems and neural network solutions: Existence and error estimates

Error estimates of residual minimization using neural networks for linear PDEs

Solving Partial Differential Equations Using Artificial Neural Networks

Correctness Verification of Neural Networks Approximating Differential Equations

A Discussion on Solving Partial Differential Equations using Neural Networks

Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theory

On quadrature rules for solving Partial Differential Equations using Neural Networks

A Priori Estimation of the Approximation, Optimization and Generalization Errors of Random Neural Networks for Solving Partial Differential Equations

Adaptive Two-Layer ReLU Neural Network: II. Ritz Approximation to Elliptic PDEs

On the approximation of the solution of partial differential equations by artificial neural networks trained by a multilevel Levenberg-Marquardt method

A PDE Perspective on Approximating Nonlocal Periodic Operators with Applications on Neural Networks for Critical SQG Equations

Neural networks catching up with finite differences in solving partial differential equations in higher dimensions

A Stable and Scalable Method for Solving Initial Value PDEs with Neural Networks

Regularity-Conforming Neural Networks (ReCoNNs) for solving Partial Differential Equations

Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Data

Learning Partial Differential Equations from Data Using Neural Networks

A Least-Squares-Based Neural Network (LS-Net) for Solving Linear Parametric PDEs

Neural Q-learning for solving elliptic PDEs

First Order System Least Squares Neural Networks

Subspace method based on neural networks for solving the partial differential equation

Physics informed neural networks for elliptic equations with oscillatory differential operators