Abstract:One of the open problems in scientific computing is the long-time integration of nonlinear stochastic partial differential equations (SPDEs), especially with arbitrary initial data. We address this problem by taking advantage of recent advances in scientific machine learning and the spectral dynamically orthogonal (DO) and borthogonal (BO) methods for representing stochastic processes. The recently introduced DO/BO methods reduce the SPDE to solving a system of deterministic PDEs and a system of stochastic ordinary differential equations. Specifically, we propose two new physics-informed neural networks (PINNs) for solving time-dependent SPDEs, namely the neural network (NN)-DO/BO methods. The proposed methods incorporate the DO/BO constraints into the loss function (along with the modal decomposition of the SPDE) with an implicit form instead of generating explicit expressions for the temporal derivatives of the DO/BO modes. Hence, the NN-DO/BO methods can overcome some of the drawbacks of the original DO/BO methods. For example, we do not need the assumption that the covariance matrix of the random coefficients is invertible as in the original DO method, and we can remove the assumption of no eigenvalue crossing as in the original BO method. Moreover, the NN-DO/BO methods can be used to solve time-dependent stochastic inverse problems with the same formulation and same computational complexity as for forward problems. We demonstrate the capability of the proposed methods via several numerical examples, namely: (1) A linear stochastic advection equation with deterministic initial condition: we obtain good results with the proposed methods, while the original DO/BO methods cannot be applied directly in this case. (2) Long-time integration of the stochastic Burgers' equation: we show the good performance of NN-DO/BO methods, especially the effectiveness of the NN-BO approach for such problems with many eigenvalue crossings during the whole time evolution, while the original BO method fails. (3) Nonlinear reaction diffusion equation: we consider both the forward problem and the inverse problems, including very noisy initial point values, to investigate the flexibility of the NN-DO/BO methods in handling inverse and mixed type problems. Taken together, these simulation results demonstrate that the NN-DO/BO methods can be employed to effectively quantify uncertainty propagation in a wide range of physical problems, but future work should address the efficiency issue of PINNs for forward problems.

Continuous probabilistic solution to the transient self-oscillation under stochastic forcing: a PINN approach

Stochastic Averaging Of Strongly Nonlinear Oscillators Under Poisson White Noise Excitation

Stochastic Averaging of Strongly Nonlinear Oscillators Under Combined Harmonic and Wide-Band Noise Excitations

Physics-informed neural nets for control of dynamical systems

Physics-Informed Solution of The Stationary Fokker-Plank Equation for a Class of Nonlinear Dynamical Systems: An Evaluation Study

Characteristic Performance Study on Solving Oscillator ODEs via Soft-constrained Physics-informed Neural Network with Small Data

Non-stationary nonzero mean probabilistic solutions of nonlinear stochastic oscillators subjected to both additive and multiplicative excitations

Bi-orthogonal fPINN: A physics-informed neural network method for solving time-dependent stochastic fractional PDEs

Exact Enforcement of Temporal Continuity in Sequential Physics-Informed Neural Networks

An efficient wavelet-based physics-informed neural networks for singularly perturbed problems

Semi-analytic PINN methods for singularly perturbed boundary value problems

PINN-wf: A PINN-based algorithm for data-driven solution and parameter discovery of the Hirota equation appearing in communications and finance

PINNs-Based Uncertainty Quantification for Transient Stability Analysis

Physics-informed neural networks with parameter asymptotic strategy for learning singularly perturbed convection-dominated problem

RAR-PINN algorithm for the data-driven vector-soliton solutions and parameter discovery of coupled nonlinear equations

Data-driven solutions and parameter estimations of a family of higher-order KdV equations based on physics informed neural networks

Addressing the Non-perturbative Regime of the Quantum Anharmonic Oscillator by Physics-Informed Neural Networks

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

A numerically efficient output-only system-identification framework for stochastically forced self-sustained oscillators

Transformed Physics-Informed Neural Networks for The Convection-Diffusion Equation