Subspace method based on neural networks for solving the partial differential equation

Zhaodong Xu,Zhiqiang Sheng

2024-04-12

Abstract:We present a subspace method based on neural networks (SNN) for solving the partial differential equation with high accuracy. The basic idea of our method is to use some functions based on neural networks as base functions to span a subspace, then find an approximate solution in this subspace. We design two special algorithms in the strong form of partial differential equation. One algorithm enforces the equation and initial boundary conditions to hold on some collocation points, and another algorithm enforces $L^2$-norm of the residual of the equation and initial boundary conditions to be $0$. Our method can achieve high accuracy with low cost of training. Moreover, our method is free of parameters that need to be artificially adjusted. Numerical examples show that the cost of training these base functions of subspace is low, and only one hundred to two thousand epochs are needed for most tests. The error of our method can even fall below the level of $10^{-10}$ for some tests. The performance of our method significantly surpasses the performance of PINN and DGM in terms of the accuracy and computational cost.

Numerical Analysis

What problem does this paper attempt to address?

The paper aims to address the issue of high accuracy and low computational cost in solving partial differential equations (PDEs). Specifically, the authors propose a subspace method based on neural networks (SNN) for efficiently and accurately solving PDEs. The basic idea of this method is to construct a subspace using a set of basis functions generated by neural networks and to find an approximate solution within this subspace. Compared to existing deep neural network-based methods (such as Physics-Informed Neural Networks (PINN) and Deep Galerkin Method (DGM)), this method can achieve higher accuracy while significantly reducing training costs.

The authors achieve this goal through two algorithms: one enforces the equations and their initial boundary conditions in discrete form (referred to as SNN-D), and the other minimizes the L2 norm of the residuals of the equations and their initial boundary conditions in integral form (referred to as SNN-I). Both algorithms do not require manual parameter tuning, thus avoiding the hyperparameter selection problem present in existing methods. Numerical experimental results show that the SNN method can achieve extremely high accuracy (with errors even below the 10^-10 level) with only a few hundred to 2000 training epochs, far outperforming PINN and DGM in terms of accuracy and computational cost.