Abstract:Physics informed neural networks (PINNs) are a novel deep learning paradigm primed for solving forward and inverse problems of nonlinear partial differential equations (PDEs). By embedding physical information delineated by PDEs in feedforward neural networks, PINNs are trained as surrogate models for approximate solution to the PDEs without need of label data. Due to the excellent capability of neural networks in describing complex relationships, a variety of PINN-based methods have been developed to solve different kinds of problems such as integer-order PDEs, fractional PDEs, stochastic PDEs and integro-differential equations (IDEs). However, for the state-of-the-art PINN methods in application to IDEs, integral discretization is a key prerequisite in order that IDEs can be transformed into ordinary differential equations (ODEs). However, integral discretization inevitably introduces discretization error and truncation error to the solution. In this study, we propose an auxiliary physics informed neural network (A-PINN) framework for solving forward and inverse problems of nonlinear IDEs. By defining auxiliary output variable(s) to represent the integral(s) in the governing equation and employing automatic differentiation of the auxiliary output to replace integral operator, the proposed A-PINN bypasses the limitation of integral discretization. Distinct from the neural network in the original PINN which only approximates the variables in the governing equation, in the proposed A-PINN framework, a multi-output neural network is constructed to simultaneously calculate the primary outputs and auxiliary outputs which respectively approximate the variables and integrals in the governing equation. Subsequently, the relationship between the primary outputs and auxiliary outputs is constrained by new output conditions in compliance with physical laws. By pursuing the first-order nonlinear Volterra IDE benchmark problem, we validate that the proposed A-PINN can obtain more accurate solution than the conventional PINN. We further demonstrate the good performance of A-PINN in solving the forward problems involving nonlinear Volterra IDEs system, nonlinear 2-dimensional Volterra IDE, nonlinear 10-dimensional Volterra IDE, and nonlinear Fredholm IDE. Finally, the A-PINN framework is implemented to solve the inverse problem of nonlinear IDEs and the results show that the unknown parameters can be satisfactorily discovered even with heavily noisy data.

A novel normalized reduced-order physics-informed neural network for solving inverse problems

Data-Guided Physics-Informed Neural Networks for Solving Inverse Problems in Partial Differential Equations

Reduced-PINN: An Integration-Based Physics-Informed Neural Networks for Stiff ODEs

A novel discretized physics-informed neural network model applied to the Navier-Stokes equations

A Review of Physics Informed Neural Networks for Multiscale Analysis and Inverse Problems

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

An Efficient Framework for Solving Forward and Inverse Problems of Nonlinear Partial Differential Equations Via Enhanced Physics-Informed Neural Network Based on Adaptive Learning

A-PINN: Auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro-differential equations

Inverse Physics-Informed Neural Networks for transport models in porous materials

B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data

Efficient Bayesian inference using physics-informed invertible neural networks for inverse problems

QP Based Constrained Optimization for Reliable PINN Training

Generalized conditional symmetry enhanced physics-informed neural network and application to the forward and inverse problems of nonlinear diffusion equations

Incorporating Lasso Regression to Physics-Informed Neural Network for Inverse PDE Problem

A non-intrusive neural network model order reduction algorithm for parameterized parabolic PDEs

Physics-informed neural network solution of thermo-hydro-mechanical (THM) processes in porous media

Laplace-fPINNs: Laplace-based fractional physics-informed neural networks for solving forward and inverse problems of subdiffusion

Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios

Distributed physics informed neural network for data-efficient solution to partial differential equations

Machine Learning Through Physics–Informed Neural Networks: Progress and Challenges

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects