Abstract:We present a neural network-based method for solving linear and nonlinear partial differential equations, by combining the ideas of extreme learning machines (ELM), domain decomposition and local neural networks. The field solution on each sub-domain is represented by a local feed-forward neural network, and $C^k$ continuity is imposed on the sub-domain boundaries. Each local neural network consists of a small number of hidden layers, while its last hidden layer can be wide. The weight/bias coefficients in all hidden layers of the local neural networks are pre-set to random values and are fixed, and only the weight coefficients in the output layers are training parameters. The overall neural network is trained by a linear or nonlinear least squares computation, not by the back-propagation type algorithms. We introduce a block time-marching scheme together with the presented method for long-time dynamic simulations. The current method exhibits a clear sense of convergence with respect to the degrees of freedom in the neural network. Its numerical errors typically decrease exponentially or nearly exponentially as the number of degrees of freedom increases. Extensive numerical experiments have been performed to demonstrate the computational performance of the presented method. We compare the current method with the deep Galerkin method (DGM) and the physics-informed neural network (PINN) in terms of the accuracy and computational cost. The current method exhibits a clear superiority, with its numerical errors and network training time considerably smaller (typically by orders of magnitude) than those of DGM and PINN. We also compare the current method with the classical finite element method (FEM). The computational performance of the current method is on par with, and oftentimes exceeds, the FEM performance.

Adaptive multilayer neural network for solving elliptic partial differential equations with different boundary conditions

Surrogate-Based Physics-Informed Neural Networks for Elliptic Partial Differential Equations

A reduced order Schwarz method for nonlinear multiscale elliptic equations based on two-layer neural networks

Solving two-dimensional linear partial differential equations based on Chebyshev neural network with extreme learning machine algorithm

Solving multiscale elliptic problems by sparse radial basis function neural networks

Numerical solution for high-dimensional partial differential equations based on deep learning with residual learning and data-driven learning

Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations

Adaptive neural network basis methods for partial differential equations with low-regular solutions

Multilevel CNNs for Parametric PDEs

Adaptive Multilevel Neural Networks for Parametric PDEs with Error Estimation

Deep neural network approximation for high-dimensional elliptic PDEs with boundary conditions

Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Space

Solving High-Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

Subspace method based on neural networks for solving the partial differential equation

Adaptive multi-scale neural network with Resnet blocks for solving partial differential equations

Multi-level Neural Networks for Accurate Solutions of Boundary-Value Problems

Adaptive Neural Network Subspace Method for Solving Partial Differential Equations with High Accuracy

Numerical approximation based on deep convolutional neural network for high‐dimensional fully nonlinear merged PDEs and 2BSDEs

A Non-Gradient Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks.

Convolution-Based Model-Solving Method for Three-Dimensional, Unsteady, Partial Differential Equations

Solving Partial Differential Equations Using Point-Based Neural Networks.