Abstract:Physics-informed neural networks (PINNs) were recently proposed in [18] as an alternative way to solve partial differential equations (PDEs). A neural network (NN) represents the solution, while a PDE-induced NN is coupled to the solution NN, and all differential operators are treated using automatic differentiation. Here, we first employ the standard PINN and a stochastic version, sPINN, to solve forward and inverse problems governed by a non-linear advection–diffusion–reaction (ADR) equation, assuming we have some sparse measurements of the concentration field at random or pre-selected locations. Subsequently, we attempt to optimise the hyper-parameters of sPINN by using the Bayesian optimisation method (meta-learning) and compare the results with the empirically selected hyper-parameters of sPINN. In particular, for the first part in solving the inverse deterministic ADR, we assume that we only have a few high-fidelity measurements, whereas the rest of the data is of lower fidelity. Hence, the PINN is trained using a composite multi-fidelity network, first introduced in [12], that learns the correlations between the multi-fidelity data and predicts the unknown values of diffusivity, transport velocity and two reaction constants as well as the concentration field. For the stochastic ADR, we employ a Karhunen–Loève (KL) expansion to represent the stochastic diffusivity, and arbitrary polynomial chaos (aPC) to represent the stochastic solution. Correspondingly, we design multiple NNs to represent the mean of the solution and learn each aPC mode separately, whereas we employ a separate NN to represent the mean of diffusivity and another NN to learn all modes of the KL expansion. For the inverse problem, in addition to stochastic diffusivity and concentration fields, we also aim to obtain the (unknown) deterministic values of transport velocity and reaction constants. The available data correspond to 7spatial points for the diffusivity and 20 space–time points for the solution, both sampled 2000 times. We obtain good accuracy for the deterministic parameters of the order of 1–2% and excellent accuracy for the mean and variance of the stochastic fields, better than three digits of accuracy. In the second part, we consider the previous stochastic inverse problem, and we use Bayesian optimisation to find five hyper-parameters of sPINN, namely the width, depth and learning rate of two NNs for learning the modes. We obtain much deeper and wider optimal NNs compared to the manual tuning, leading to even better accuracy, i.e., errors less than 1% for the deterministic values, and about an order of magnitude less for the stochastic fields.

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

Bi-orthogonal fPINN: A physics-informed neural network method for solving time-dependent stochastic fractional PDEs

Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems

TSONN: Time-stepping-oriented neural network for solving partial differential equations

Learning and meta-learning of stochastic advection–diffusion–reaction systems from sparse measurements

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

An Efficient Framework for Solving Forward and Inverse Problems of Nonlinear Partial Differential Equations Via Enhanced Physics-Informed Neural Network Based on Adaptive Learning

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

Bayesian Deep Learning Framework for Uncertainty Quantification in Stochastic Partial Differential Equations

Exact Enforcement of Temporal Continuity in Sequential Physics-Informed Neural Networks

Combining physics-informed graph neural network and finite difference for solving forward and inverse spatiotemporal PDEs

An Efficient Approximation Method Based on Enhanced Physics-Informed Neural Networks for Solving Localized Wave Solutions of PDEs

Data-Guided Physics-Informed Neural Networks for Solving Inverse Problems in Partial Differential Equations

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

Physics-Informed Solution of The Stationary Fokker-Plank Equation for a Class of Nonlinear Dynamical Systems: An Evaluation Study

Operator Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations Characterized by Sharp Solutions

Spectrally Adapted Physics-Informed Neural Networks for Solving Unbounded Domain Problems

Physics-informed Neural Network Algorithm for Solving Forward and Inverse Problems of Variable-Order Space-Fractional Advection–diffusion Equations

Solving Inverse Stochastic Problems from Discrete Particle Observations Using the Fokker-Planck Equation and Physics-informed Neural Networks

Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks