Abstract:Recent years have witnessed growing interests in solving partial differential equations by deep neural networks, especially in the high-dimensional case. Unlike classical numerical methods, such as finite difference method and finite element method, the enforcement of boundary conditions in deep neural networks is highly nontrivial. One general strategy is to use the penalty method. In the work, we conduct a comparison study for elliptic problems with four different boundary conditions, i.e., Dirichlet, Neumann, Robin, and periodic boundary conditions, using two representative methods: deep Galerkin method and deep Ritz method. In the former, the PDE residual is minimized in the least-squares sense while the corresponding variational problem is minimized in the latter. Therefore, it is reasonably expected that deep Galerkin method works better for smooth solutions while deep Ritz method works better for low-regularity solutions. However, by a number of examples, we observe that deep Ritz method can outperform deep Galerkin method with a clear dependence of dimensionality even for smooth solutions and deep Galerkin method can also outperform deep Ritz method for low-regularity solutions. Besides, in some cases, when the boundary condition can be implemented in an exact manner, we find that such a strategy not only provides a better approximate solution but also facilitates the training process.

Deep Ritz Methods for Laplace Equations with Dirichlet Boundary Condition

Convergence Rate Analysis for Deep Ritz Method

Error Analysis of Deep Ritz Methods for Elliptic Equations.

Deep Ritz Method with Adaptive Quadrature for Linear Elasticity

A Natural Deep Ritz Method for Essential Boundary Value Problems

Deep Ritz method for the spectral fractional Laplacian equation using the Caffarelli-Silvestre extension

Statistical Numerical PDE : Fast Rate, Neural Scaling Law and When it’s Optimal

Convergence Analysis of a Quasi-Monte Carlo-based Deep Learning Algorithm for Solving Partial Differential Equations

Refined generalization analysis of the Deep Ritz Method and Physics-Informed Neural Networks

A comparison study of deep Galerkin method and deep Ritz method for elliptic problems with different boundary conditions

Machine Learning For Elliptic PDEs: Fast Rate Generalization Bound, Neural Scaling Law and Minimax Optimality

DRM Revisited: A Complete Error Analysis

A Priori Error Estimate of Deep Mixed Residual Method for Elliptic PDEs

Error Analysis of Three-Layer Neural Network Trained with PGD for Deep Ritz Method

A Deep Uzawa-Lagrange Multiplier Approach for Boundary Conditions in PINNs and Deep Ritz Methods

Analysis of Deep Ritz Methods for Semilinear Elliptic Equations

A Deep Double Ritz Method (D$^2$RM) for solving Partial Differential Equations using Neural Networks

Deep Ritz -- Finite Element methods: Neural Network Methods trained with Finite Elements

The Deep Ritz Method for Parametric $p$-Dirichlet Problems

Solving the Poisson Equation with Dirichlet data by shallow ReLU$^α$-networks: A regularity and approximation perspective

The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems