Abstract:Implementing deep neural networks for learning the solution maps of parametric partial differential equations (PDEs) turns out to be more efficient than using many conventional numerical methods. However, limited theoretical analyses have been conducted on this approach. In this study, we investigate the expressive power of deep rectified quadratic unit (ReQU) neural networks for approximating the solution maps of parametric PDEs. The proposed approach is motivated by the recent important work of G. Kutyniok, P. Petersen, M. Raslan and R. Schneider (Gitta Kutyniok, Philipp Petersen, Mones Raslan, and Reinhold Schneider. A theoretical analysis of deep neural networks and parametric pdes. Constructive Approximation, pages 1-53, 2021), which uses deep rectified linear unit (ReLU) neural networks for solving parametric PDEs. In contrast to the previously established complexity-bound $\mathcal{O}\left(d^3\log_{2}^{q}(1/ \epsilon) \right)$ for ReLU neural networks, we derive an upper bound $\mathcal{O}\left(d^3\log_{2}^{q}\log_{2}(1/ \epsilon) \right)$ on the size of the deep ReQU neural network required to achieve accuracy $\epsilon>0$, where $d$ is the dimension of reduced basis representing the solutions. Our method takes full advantage of the inherent low-dimensionality of the solution manifolds and better approximation performance of deep ReQU neural networks. Numerical experiments are performed to verify our theoretical result.

Analysis of Deep Ritz Methods for Semilinear Elliptic Equations

Error Analysis of Deep Ritz Methods for Elliptic Equations.

Convergence Rate Analysis for Deep Ritz Method

Deep Ritz Method for Elliptical Multiple Eigenvalue Problems

Deep Ritz Methods for Laplace Equations with Dirichlet Boundary Condition

Error Analysis of the Deep Mixed Residual Method for High-order Elliptic Equations

A comparison study of deep Galerkin method and deep Ritz method for elliptic problems with different boundary conditions

A Natural Deep Ritz Method for Essential Boundary Value Problems

Deep Ritz Method with Adaptive Quadrature for Linear Elasticity

A Priori Error Estimate of Deep Mixed Residual Method for Elliptic PDEs

Deep Ritz -- Finite Element methods: Neural Network Methods trained with Finite Elements

The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems

A Deep Double Ritz Method (D$^2$RM) for solving Partial Differential Equations using Neural Networks

Adaptive Two-Layer ReLU Neural Network: II. Ritz Approximation to Elliptic PDEs

Solving parametric partial differential equations with deep rectified quadratic unit neural networks

Error Analysis of Three-Layer Neural Network Trained with PGD for Deep Ritz Method

Deep Ritz method for the spectral fractional Laplacian equation using the Caffarelli-Silvestre extension

A shallow Ritz method for elliptic problems with singular sources

Solving the Poisson Equation with Dirichlet data by shallow ReLU$^α$-networks: A regularity and approximation perspective

Error Analysis of Mixed Residual Methods for Elliptic Equations

Refined generalization analysis of the Deep Ritz Method and Physics-Informed Neural Networks