Abstract:Solving high-dimensional partial diﬀerential equations (PDEs) is a major challenge in scientiﬁc computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning. Our “Q-PDE” algorithm is mesh-free and therefore has the potential to overcome the curse of dimensionality. Using a neural tangent kernel (NTK) approach, we prove that the neural network approximator for the PDE solution, trained with the Q-PDE algorithm, converges to the trajectory of an inﬁnite-dimensional ordinary diﬀerential equation (ODE) as the number of hidden units → ∞ . For monotone PDE (i.e. those given by monotone operators, which may be nonlinear), despite the lack of a spectral gap in the NTK, we then prove that the limit neural network, which satisﬁes the inﬁnite-dimensional ODE, converges in L 2 to the PDE solution as the training time → ∞ . More generally, we can prove that any ﬁxed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition). The numerical performance of the Q-PDE algorithm is studied for several elliptic PDEs. this approach to study the performance of the biased gradient ﬂow as a training algorithm, and show that the wide-network limit satisﬁes an inﬁnite-dimensional ordinary diﬀerential equation (ODE).Weapply our Q-PDE approach to monotone PDEs, that is, where the diﬀerential operator satisﬁes a strong monotonicity condition. Monotone PDEs arise in various applications, particularly in PDEs arising from stochastic modeling – the generators of ergodic stochastic processes are monotone (when evaluated with their stationary distributions), which suggests a variety of possible applications of our approach. Further, the subdiﬀerentials of convex functionals (i.e. of maps from functions to the real line) are monotone; this suggests that monotone PDEs may be a particularly well-suited class of equations for gradient methods, as they correspond to (a generalization of) minimizations of convex functionals. We will see that, given this monotonicity assumption, we can prove that the limit Q-PDE algorithm will converge (strongly in L 2 ) to the solution of the monotone PDE. More generally, we can prove that any ﬁxed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition).

Gauss Newton method for solving variational problems of PDEs with neural network discretizaitons

Gauss Newton Method for Solving Variational Problems of PDEs with Neural Network Discretizaitons

A randomized Newton's method for solving differential equations based on the neural network discretization

Neural-Network-Assisted Finite Difference Discretization for Numerical Solution of Partial Differential Equations

Subspace method based on neural networks for solving the partial differential equation

A Non-Gradient Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks.

Neural Q-learning for solving elliptic PDEs

Gradient Convergence of Deep Learning-Based Numerical Methods for BSDEs

Energetic Variational Neural Network Discretizations of Gradient Flows

Quasi-Monte Carlo sampling for machine-learning partial differential equations

Gauss-Newton Dynamics for Neural Networks: A Riemannian Optimization Perspective

A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networks

Gauss-Newton Natural Gradient Descent for Physics-Informed Computational Fluid Dynamics

A Stable and Scalable Method for Solving Initial Value PDEs with Neural Networks

Numerical Solution of the Parametric Diffusion Equation by Deep Neural Networks

Finite-difference least square methods for solving Hamilton-Jacobi equations using neural networks

Deep Petrov-Galerkin Method for Solving Partial Differential Equations

A Natural Primal-Dual Hybrid Gradient Method for Adversarial Neural Network Training on Solving Partial Differential Equations

Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equations

Time integration schemes based on neural networks for solving partial differential equations on coarse grids