Abstract:Solving high-dimensional partial diﬀerential equations (PDEs) is a major challenge in scientiﬁc computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning. Our “Q-PDE” algorithm is mesh-free and therefore has the potential to overcome the curse of dimensionality. Using a neural tangent kernel (NTK) approach, we prove that the neural network approximator for the PDE solution, trained with the Q-PDE algorithm, converges to the trajectory of an inﬁnite-dimensional ordinary diﬀerential equation (ODE) as the number of hidden units → ∞ . For monotone PDE (i.e. those given by monotone operators, which may be nonlinear), despite the lack of a spectral gap in the NTK, we then prove that the limit neural network, which satisﬁes the inﬁnite-dimensional ODE, converges in L 2 to the PDE solution as the training time → ∞ . More generally, we can prove that any ﬁxed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition). The numerical performance of the Q-PDE algorithm is studied for several elliptic PDEs. this approach to study the performance of the biased gradient ﬂow as a training algorithm, and show that the wide-network limit satisﬁes an inﬁnite-dimensional ordinary diﬀerential equation (ODE).Weapply our Q-PDE approach to monotone PDEs, that is, where the diﬀerential operator satisﬁes a strong monotonicity condition. Monotone PDEs arise in various applications, particularly in PDEs arising from stochastic modeling – the generators of ergodic stochastic processes are monotone (when evaluated with their stationary distributions), which suggests a variety of possible applications of our approach. Further, the subdiﬀerentials of convex functionals (i.e. of maps from functions to the real line) are monotone; this suggests that monotone PDEs may be a particularly well-suited class of equations for gradient methods, as they correspond to (a generalization of) minimizations of convex functionals. We will see that, given this monotonicity assumption, we can prove that the limit Q-PDE algorithm will converge (strongly in L 2 ) to the solution of the monotone PDE. More generally, we can prove that any ﬁxed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition).

A PDE Perspective on Approximating Nonlocal Periodic Operators with Applications on Neural Networks for Critical SQG Equations

Quantitative Approximation for Neural Operators in Nonlinear Parabolic Equations

Deep learning approximations for non-local nonlinear PDEs with Neumann boundary conditions

Neural Q-learning for solving elliptic PDEs

Neural Q-learning for solving PDEs

Some elliptic second order problems and neural network solutions: Existence and error estimates

On quadrature rules for solving Partial Differential Equations using Neural Networks

Solving Partial Differential Equations Using Artificial Neural Networks

Learning Partial Differential Equations with Deep Parallel Neural Operator

Approximation of Solution Operators for High-dimensional PDEs

A Priori Estimation of the Approximation, Optimization and Generalization Errors of Random Neural Networks for Solving Partial Differential Equations

Solving partial differential equations with sampled neural networks

Solving Partial Differential Equations Using Point-Based Neural Networks.

Gauss Newton method for solving variational problems of PDEs with neural network discretizaitons

An Overview on Machine Learning Methods for Partial Differential Equations: from Physics Informed Neural Networks to Deep Operator Learning

Solving the Poisson Equation with Dirichlet data by shallow ReLU$^α$-networks: A regularity and approximation perspective

Neural Control of Parametric Solutions for High-dimensional Evolution PDEs

Adaptive quadratures for nonlinear approximation of low-dimensional PDEs using smooth neural networks

Subspace method based on neural networks for solving the partial differential equation

Diffeomorphic Latent Neural Operators for Data-Efficient Learning of Solutions to Partial Differential Equations