Deep learning methods for stochastic Galerkin approximations of elliptic random PDEs

Fabio Musco,Andrea Barth

2024-09-12

Abstract:This work considers stochastic Galerkin approximations of linear elliptic partial differential equations with stochastic forcing terms and stochastic diffusion coefficients, that cannot be bounded uniformly away from zero and infinity. A traditional numerical method for solving the resulting high-dimensional coupled system of partial differential equations (PDEs) is replaced by deep learning techniques. In order to achieve this, physics-informed neural networks (PINNs), which typically operate on the strong residual of the PDE and can therefore be applied in a wide range of settings, are considered. As a second approach, the Deep Ritz method, which is a neural network that minimizes the Ritz energy functional to find the weak solution, is employed. While the second approach only works in special cases, it overcomes the necessity of testing in variational problems while maintaining mathematical rigor and ensuring the existence of a unique solution. Furthermore, the residual is of a lower differentiation order, reducing the training cost considerably. The efficiency of the method is demonstrated on several model problems.

Numerical Analysis,Analysis of PDEs

What problem does this paper attempt to address?

The paper aims to address the issue of uncertainty quantification in random partial differential equations (RPDEs), particularly in cases where the random diffusion coefficients cannot be uniformly bounded. Traditional numerical methods face challenges when dealing with the resulting high-dimensional coupled systems of partial differential equations. Therefore, the authors propose using deep learning techniques to replace traditional methods. Specifically, the paper explores two deep learning-based approaches:

1. **Physics-Informed Neural Networks (PINNs)**: This method is typically based on the strong form residuals of partial differential equations and is applicable to a wide range of scenarios.
2. **Deep Ritz Method**: This method seeks weak solutions by minimizing the Ritz energy functional. Although it is only applicable to specific cases, it avoids the testing step in variational problems while maintaining mathematical rigor and ensuring the existence and uniqueness of solutions.

Additionally, the paper points out that the Deep Ritz Method has a lower differential order compared to PINNs, thereby reducing training costs. The effectiveness of the method is demonstrated through the study of several model problems. The main contribution of the paper is the development of two network architectures, S-GalerkinNet and S-RitzNet. S-RitzNet, based on a weighted weak form, ensures the existence and uniqueness of weak solutions and requires lower regularity assumptions on the solutions, making it suitable for low-regularity applications such as subsurface flow models.