Abstract:We present a neural network-based method for solving linear and nonlinear partial differential equations, by combining the ideas of extreme learning machines (ELM), domain decomposition and local neural networks. The field solution on each sub-domain is represented by a local feed-forward neural network, and $C^k$ continuity is imposed on the sub-domain boundaries. Each local neural network consists of a small number of hidden layers, while its last hidden layer can be wide. The weight/bias coefficients in all hidden layers of the local neural networks are pre-set to random values and are fixed, and only the weight coefficients in the output layers are training parameters. The overall neural network is trained by a linear or nonlinear least squares computation, not by the back-propagation type algorithms. We introduce a block time-marching scheme together with the presented method for long-time dynamic simulations. The current method exhibits a clear sense of convergence with respect to the degrees of freedom in the neural network. Its numerical errors typically decrease exponentially or nearly exponentially as the number of degrees of freedom increases. Extensive numerical experiments have been performed to demonstrate the computational performance of the presented method. We compare the current method with the deep Galerkin method (DGM) and the physics-informed neural network (PINN) in terms of the accuracy and computational cost. The current method exhibits a clear superiority, with its numerical errors and network training time considerably smaller (typically by orders of magnitude) than those of DGM and PINN. We also compare the current method with the classical finite element method (FEM). The computational performance of the current method is on par with, and oftentimes exceeds, the FEM performance.

Hierarchical Node Method for Solving Large-Scale Sparse Linear Equations in Parallel

Scalable Hierarchical Parallel Algorithm for the Solution of Super Large-Scale Sparse Linear Equations

Parallel Computation Of Meshfree Methods For Extremely Large Deformation Analysis

Hierarchical subspace evolution method for super large parallel computing: A linear solver and an eigensolver as examples

Parallel Computation Method For Solving Large Scale Equation-Oriented Models

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations

Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations

The Hierarchical Subspace Iteration Method for Laplace--Beltrami Eigenproblems

Hierarchical Matrices Method and Its Application in Electromagnetic Integral Equations

An Efficient Iterative Approach to Large Sparse Nonlinear Systems with Non-Hermitian Jacobian Matrices

Recursive sparse LU decomposition based on nested dissection and low rank approximations

A New Multilevel Method for Electrostatic Problems Through Hierarchical Loop Basis

High Performance Sparse Solver for Unsymmetrical Linear Equations with Out-of-core Strategies and Its Application on Meshless Methods

A two-scale solver for linear elasticity problems in the context of parallel message passing

An Efficient Adaptive Mesh Redistribution Method for a Non-Linear Dirac Equation

New development of solution of equations of motion with adaptive time-step size-linear fem based on eep superconvergence technique

A massively parallel explicit solver for elasto-dynamic problems exploiting octree meshes

Stress-aware Large-Scale Mesh Editing Using a Domain-Decomposed Multigrid Solver

Interfacing finite elements with deep neural operators for fast multiscale modeling of mechanics problems

A Newton-Krylov Method with Dense Row Decomposition for Steady-State Neutronics/thermal-Hydraulics Problems