Abstract:Compared with conventional numerical approaches to solving partial differential equations (PDEs), physics-informed neural networks (PINN) have manifested the capability to save development effort and computational cost, especially in scenarios of reconstructing the physics field and solving the inverse problem. Considering the advantages of parameter sharing, spatial feature extraction and low inference cost, convolutional neural networks (CNN) are increasingly used in PINN. However, some challenges still remain as follows. To adapt convolutional PINN to solve different PDEs, considerable effort is usually needed for tuning critical hyperparameters. Furthermore, the effects of the finite difference accuracy, and the mesh resolution on the predictivity of convolutional PINN are not settled. To fill the gaps above, we propose three initiatives in this paper: (1) A Multi-Receptive-Field PINN (MRF-PINN) model is established to solve different types of PDEs on various mesh resolutions without manual tuning; (2) The dimensional balance method is used to estimate the loss weights when solving Navier-Stokes equations; (3) The Taylor polynomial is used to pad the virtual nodes near the boundaries for implementing high-order finite difference. The proposed MRF-PINN is tested for solving three typical linear PDEs (elliptic, parabolic, hyperbolic) and a series of nonlinear PDEs (Navier-Stokes PDEs) to demonstrate its generality and superiority. This paper shows that MRF-PINN can adapt to completely different equation types and mesh resolutions without any hyperparameter tuning. The dimensional balance method saves computational time and improves the convergence for solving Navier-Stokes PDEs. Further, the solving error is significantly decreased under high-order finite difference, large channel number, and high mesh resolution, which is expected to be a general convolutional PINN scheme.

Convolution-Based Model-Solving Method for Three-Dimensional, Unsteady, Partial Differential Equations

An Efficient Method for Solving Two-Dimensional Partial Differential Equations with the Deep Operator Network

Solving Partial Differential Equations Using Point-Based Neural Networks.

An Axiomatized PDE Model of Deep Neural Networks.

Adaptive multilayer neural network for solving elliptic partial differential equations with different boundary conditions

A Non-Gradient Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks.

A Physics-Informed Neural Network Framework For Partial Differential Equations on 3D Surfaces: Time-Dependent Problems

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

A fully differentiable GNN-based PDE Solver: With Applications to Poisson and Navier-Stokes Equations

Learning Time-Dependent PDEs with a Linear and Nonlinear Separate Convolutional Neural Network

Neural networks catching up with finite differences in solving partial differential equations in higher dimensions

Numerical solution for high-dimensional partial differential equations based on deep learning with residual learning and data-driven learning

Solving High-Dimensional Partial Differential Equations Using Deep Learning.

Data-driven Derivation of Partial Differential Equations Using Neural Network Model.

Inf-Sup neural networks for high-dimensional elliptic PDE problems

MRF-PINN: A Multi-Receptive-Field convolutional physics-informed neural network for solving partial differential equations

Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Space

Neural-PDE: a RNN Based Neural Network for Solving Time Dependent PDEs

Solve High-Dimensional Reflected Partial Differential Equations by Neural Network Method

Quantifying Training Difficulty and Accelerating Convergence in Neural Network-Based PDE Solvers