Abstract:One of the open problems in scientific computing is the long-time integration of nonlinear stochastic partial differential equations (SPDEs), especially with arbitrary initial data. We address this problem by taking advantage of recent advances in scientific machine learning and the spectral dynamically orthogonal (DO) and borthogonal (BO) methods for representing stochastic processes. The recently introduced DO/BO methods reduce the SPDE to solving a system of deterministic PDEs and a system of stochastic ordinary differential equations. Specifically, we propose two new physics-informed neural networks (PINNs) for solving time-dependent SPDEs, namely the neural network (NN)-DO/BO methods. The proposed methods incorporate the DO/BO constraints into the loss function (along with the modal decomposition of the SPDE) with an implicit form instead of generating explicit expressions for the temporal derivatives of the DO/BO modes. Hence, the NN-DO/BO methods can overcome some of the drawbacks of the original DO/BO methods. For example, we do not need the assumption that the covariance matrix of the random coefficients is invertible as in the original DO method, and we can remove the assumption of no eigenvalue crossing as in the original BO method. Moreover, the NN-DO/BO methods can be used to solve time-dependent stochastic inverse problems with the same formulation and same computational complexity as for forward problems. We demonstrate the capability of the proposed methods via several numerical examples, namely: (1) A linear stochastic advection equation with deterministic initial condition: we obtain good results with the proposed methods, while the original DO/BO methods cannot be applied directly in this case. (2) Long-time integration of the stochastic Burgers' equation: we show the good performance of NN-DO/BO methods, especially the effectiveness of the NN-BO approach for such problems with many eigenvalue crossings during the whole time evolution, while the original BO method fails. (3) Nonlinear reaction diffusion equation: we consider both the forward problem and the inverse problems, including very noisy initial point values, to investigate the flexibility of the NN-DO/BO methods in handling inverse and mixed type problems. Taken together, these simulation results demonstrate that the NN-DO/BO methods can be employed to effectively quantify uncertainty propagation in a wide range of physical problems, but future work should address the efficiency issue of PINNs for forward problems.

A comparative investigation of a time‐dependent mesh method and physics‐informed neural networks to analyze the generalized Kolmogorov–Petrovsky–Piskunov equation

From Mesh to Neural Nets: A Multi-Method Evaluation of Physics-Informed Neural Networks and Galerkin Finite Element Method for Solving Nonlinear Convection-Reaction-Diffusion Equations

Combining physics-informed graph neural network and finite difference for solving forward and inverse spatiotemporal PDEs

Adaptive Moving Knots Meshless Method for Simulating Time Dependent Partial Differential Equations

General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations

Solving nonlinear Fisher–Kolmogorov–Petrovsky–Piskunov equation using two meshless methods

DMIS: Dynamic Mesh-based Importance Sampling for Training Physics-Informed Neural Networks

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

Hybrid Finite Difference with the Physics-informed Neural Network for solving PDE in complex geometries

A novel discretized physics-informed neural network model applied to the Navier-Stokes equations

Better Neural PDE Solvers Through Data-Free Mesh Movers

PPINN: Parareal physics-informed neural network for time-dependent PDEs

MRF-PINN: A Multi-Receptive-Field convolutional physics-informed neural network for solving partial differential equations

Numerical solution of two-term time-fractional PDE models arising in mathematical physics using local meshless method

Physics-informed neural network for solution of forward and inverse kinematic wave problems

A hybrid physics-informed neural network based multiscale solver as a partial differential equation constrained optimization problem

Can Physics-Informed Neural Networks beat the Finite Element Method?

Physics-Informed Graph-Mesh Networks for PDEs: A hybrid approach for complex problems