Abstract:Solving high-dimensional partial diﬀerential equations (PDEs) is a major challenge in scientiﬁc computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning. Our “Q-PDE” algorithm is mesh-free and therefore has the potential to overcome the curse of dimensionality. Using a neural tangent kernel (NTK) approach, we prove that the neural network approximator for the PDE solution, trained with the Q-PDE algorithm, converges to the trajectory of an inﬁnite-dimensional ordinary diﬀerential equation (ODE) as the number of hidden units → ∞ . For monotone PDE (i.e. those given by monotone operators, which may be nonlinear), despite the lack of a spectral gap in the NTK, we then prove that the limit neural network, which satisﬁes the inﬁnite-dimensional ODE, converges in L 2 to the PDE solution as the training time → ∞ . More generally, we can prove that any ﬁxed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition). The numerical performance of the Q-PDE algorithm is studied for several elliptic PDEs. this approach to study the performance of the biased gradient ﬂow as a training algorithm, and show that the wide-network limit satisﬁes an inﬁnite-dimensional ordinary diﬀerential equation (ODE).Weapply our Q-PDE approach to monotone PDEs, that is, where the diﬀerential operator satisﬁes a strong monotonicity condition. Monotone PDEs arise in various applications, particularly in PDEs arising from stochastic modeling – the generators of ergodic stochastic processes are monotone (when evaluated with their stationary distributions), which suggests a variety of possible applications of our approach. Further, the subdiﬀerentials of convex functionals (i.e. of maps from functions to the real line) are monotone; this suggests that monotone PDEs may be a particularly well-suited class of equations for gradient methods, as they correspond to (a generalization of) minimizations of convex functionals. We will see that, given this monotonicity assumption, we can prove that the limit Q-PDE algorithm will converge (strongly in L 2 ) to the solution of the monotone PDE. More generally, we can prove that any ﬁxed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition).

Quasi-Monte Carlo sampling for machine-learning partial differential equations

Convergence Analysis of a Quasi-Monte Carlo-based Deep Learning Algorithm for Solving Partial Differential Equations

Deep Learning Based on Randomized Quasi-Monte Carlo Method for Solving Linear Kolmogorov Partial Differential Equation

Numerical Solution of the Parametric Diffusion Equation by Deep Neural Networks

Solving partial differential equations with sampled neural networks

Monte Carlo PINNs: deep learning approach for forward and inverse problems involving high dimensional fractional partial differential equations

Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation

Monte Carlo fPINNs: Deep learning method for forward and inverse problems involving high dimensional fractional partial differential equations

On quadrature rules for solving Partial Differential Equations using Neural Networks

Gauss Newton method for solving variational problems of PDEs with neural network discretizaitons

Neural Q-learning for solving elliptic PDEs

Deep neural network approximations for Monte Carlo algorithms

Adaptive quadratures for nonlinear approximation of low-dimensional PDEs using smooth neural networks

Solving parametric partial differential equations with deep rectified quadratic unit neural networks

Neural Q-learning for solving PDEs

Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations

Adaptive importance sampling for Deep Ritz

Deep learning based numerical approximation algorithms for stochastic partial differential equations and high-dimensional nonlinear filtering problems

The Seven-League Scheme: Deep Learning for Large Time Step Monte Carlo Simulations of Stochastic Differential Equations