Abstract:Deep neural network provides an effective way to solve partial differential equations (PDEs) where physics-informed neural network (PINN) is a typical representative of which the outputs are constrained to approximate the solution of PDEs. However, the PINN method still fails to learn some solutions of particular properties and the reasons of failure are still unclear. In this paper, we employ both the loss landscape of the final optimization parameters of network and the imbalance of back-propagation gradient during the training to analyze why the PINN method fails to learn large amplitude solution and high-frequency solution of the Klein–Gordon equation. Consequently, we find that the PDE-based soft constraints in the loss function take a major responsibility for the failures of the PINN method in predicting such types of solutions. To remedy the pathologies we remove the PDE-based soft constraints in the loss function and calibrate a supervised learning model for predicting such types of particular solutions for a class of PDEs which cannot be learned by the PINN method and the two weight-related improved PINN methods. Specifically, if the governing PDEs under study admit a Lie symmetry group and the unique solution of the corresponding initial boundary problem is obtained via the symmetry group, we utilize the symmetry group to generate labeled data in the interior domain of PDEs from the discrete points on the known initial and boundary conditions. Then, with the labeled data we leverage the supervised learning model to predict the large amplitude solution and the high-frequency solution of the Klein–Gordon equation on a rectangular domain by means of a space–time translation group and a singular solution of the heat equation on a moving boundary domain with a physical symmetry group. Numerical experiments confirm the good performances of the proposed supervised learning method.

GsPINN: A novel fast Green kernel solver based on symmetric Physics-Informed neural networks

Enforcing continuous symmetries in physics-informed neural network for solving forward and inverse problems of partial differential equations

Generalized conditional symmetry enhanced physics-informed neural network and application to the forward and inverse problems of nonlinear diffusion equations

A Spatial-Temporally Adaptive PINN Framework for 3D Bi-Ventricular Electrophysiological Simulations and Parameter Inference

Enforcing generalized conditional symmetry in physics-informed neural network for solving the KdV-like equation with Robin initial/boundary conditions

A Symmetry Group Based Supervised Learning Method for Solving Partial Differential Equations

Symmetry group based domain decomposition to enhance physics-informed neural networks for solving partial differential equations

General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations

ST-PINN: A Self-Training Physics-Informed Neural Network for Partial Differential Equations

Invariant deep neural networks under the finite group for solving partial differential equations

SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEs

Separable Physics-informed Neural Networks for Solving the BGK Model of the Boltzmann Equation

SK-PINN: Accelerated physics-informed deep learning by smoothing kernel gradients

Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems

Binary structured physics-informed neural networks for solving equations with rapidly changing solutions

RBF-MGN:Solving spatiotemporal PDEs with Physics-informed Graph Neural Network

PhyGNNet: Solving spatiotemporal PDEs with Physics-informed Graph Neural Network

Physics-Informed Neural Networks with Trust-Region Sequential Quadratic Programming

Combining physics-informed graph neural network and finite difference for solving forward and inverse spatiotemporal PDEs

Physics-Informed neural network solver for numerical analysis in geoengineering

An Efficient Framework for Solving Forward and Inverse Problems of Nonlinear Partial Differential Equations Via Enhanced Physics-Informed Neural Network Based on Adaptive Learning