Abstract:Physics-informed neural networks (PINNs) were recently proposed in [18] as an alternative way to solve partial differential equations (PDEs). A neural network (NN) represents the solution, while a PDE-induced NN is coupled to the solution NN, and all differential operators are treated using automatic differentiation. Here, we first employ the standard PINN and a stochastic version, sPINN, to solve forward and inverse problems governed by a non-linear advection–diffusion–reaction (ADR) equation, assuming we have some sparse measurements of the concentration field at random or pre-selected locations. Subsequently, we attempt to optimise the hyper-parameters of sPINN by using the Bayesian optimisation method (meta-learning) and compare the results with the empirically selected hyper-parameters of sPINN. In particular, for the first part in solving the inverse deterministic ADR, we assume that we only have a few high-fidelity measurements, whereas the rest of the data is of lower fidelity. Hence, the PINN is trained using a composite multi-fidelity network, first introduced in [12], that learns the correlations between the multi-fidelity data and predicts the unknown values of diffusivity, transport velocity and two reaction constants as well as the concentration field. For the stochastic ADR, we employ a Karhunen–Loève (KL) expansion to represent the stochastic diffusivity, and arbitrary polynomial chaos (aPC) to represent the stochastic solution. Correspondingly, we design multiple NNs to represent the mean of the solution and learn each aPC mode separately, whereas we employ a separate NN to represent the mean of diffusivity and another NN to learn all modes of the KL expansion. For the inverse problem, in addition to stochastic diffusivity and concentration fields, we also aim to obtain the (unknown) deterministic values of transport velocity and reaction constants. The available data correspond to 7spatial points for the diffusivity and 20 space–time points for the solution, both sampled 2000 times. We obtain good accuracy for the deterministic parameters of the order of 1–2% and excellent accuracy for the mean and variance of the stochastic fields, better than three digits of accuracy. In the second part, we consider the previous stochastic inverse problem, and we use Bayesian optimisation to find five hyper-parameters of sPINN, namely the width, depth and learning rate of two NNs for learning the modes. We obtain much deeper and wider optimal NNs compared to the manual tuning, leading to even better accuracy, i.e., errors less than 1% for the deterministic values, and about an order of magnitude less for the stochastic fields.

Asymptotic-preserving neural networks for the semiconductor Boltzmann equation and its application on inverse problems

A Physics-Informed Neural Networks Algorithm for Simulating Semiconductor Devices

Asymptotic-preserving neural networks for multiscale Vlasov-Poisson-Fokker-Planck system in the high-field regime

Asymptotic-Preserving Neural Networks for Multiscale Time-Dependent Linear Transport Equations

Asymptotic-Preserving Neural Networks for Multiscale Vlasov–Poisson–Fokker–Planck System in the High-Field Regime

AP-MIONet: Asymptotic-preserving multiple-input neural operators for capturing the high-field limits of collisional kinetic equations

Using neural networks to accelerate the solution of the Boltzmann equation

Macroscopic auxiliary asymptotic preserving neural networks for the linear radiative transfer equations

Physics-informed neural networks with parameter asymptotic strategy for learning singularly perturbed convection-dominated problem

A model-data asymptotic-preserving neural network method based on micro-macro decomposition for gray radiative transfer equations

Deep neural network methods for solving forward and inverse problems of time fractional diffusion equations with conformable derivative

Asymptotic-Preserving Numerical Schemes For The Semiconductor Boltzmann Equation Efficient In The High Field Regime

Asymptotic Preserving Scheme for Anisotropic Elliptic Equations with Deep Neural Network.

Learning and meta-learning of stochastic advection–diffusion–reaction systems from sparse measurements

Neural Networks Asymptotic Behaviours for the Resolution of Inverse Problems

Capturing the Diffusive Behavior of the Multiscale Linear Transport Equations by Asymptotic-Preserving Convolutional DeepONets

Error estimates of physics-informed neural networks for approximating Boltzmann equation

Solving Inverse Problems in Steady State Navier-Stokes Equations using Deep Neural Networks

Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation

A spectral method for a Fokker-Planck equation in neuroscience with applications in neural networks with learning rules

An Efficient Framework for Solving Forward and Inverse Problems of Nonlinear Partial Differential Equations Via Enhanced Physics-Informed Neural Network Based on Adaptive Learning