Abstract:The discovery of partial differential equations (PDEs) from datasets has attracted increased attention. However, the discovery of governing equations from sparse data with high noise is still very challenging due to the difficulty of derivatives computation and the disturbance of noise. Moreover, the selection principles for the candidate library to meet physical laws need to be further studied. The invariance is one of the fundamental laws for governing equations. In this study, we propose an invariance constrained deep learning network (ICNet) for the discovery of PDEs. Considering that temporal and spatial translation invariance (Galilean invariance) is a fundamental property of physical laws, we filter the candidates that cannot meet the requirement of the Galilean transformations. Subsequently, we embedded the fixed and possible terms into the loss function of neural network, significantly countering the effect of sparse data with high noise. Then, by filtering out redundant terms without fixing learnable parameters during the training process, the governing equations discovered by the ICNet method can effectively approximate the real governing equations. We select the one-dimensional (1D) Kuramoto–Sivashinsky equation, the two-dimensional (2D) Burgers equation, the equation of two-dimensional channel flow over an obstacle, and the equation of three-dimensional (3D) intracranial aneurysm as examples to verify the superiority of the ICNet for fluid mechanics. Furthermore, we extend similar invariance methods to the discovery of wave equation (Lorentz Invariance) and verify it through single and coupled Klein–Gordon equation. The results show that the ICNet method with physical constraints exhibits excellent performance in governing equations discovery from sparse and noisy data.

Variational Inverting Network for Statistical Inverse Problems of Partial Differential Equations

Bayesian Inference and Deep Learning for Inverse Problems

VARIATIONAL BAYES' METHOD FOR FUNCTIONS WITH APPLICATIONS TO SOME INVERSE PROBLEMS

VI-DGP: A Variational Inference Method with Deep Generative Prior for Solving High-Dimensional Inverse Problems

Stein Variational Gradient Descent on Infinite-Dimensional Space and Applications to Statistical Inverse Problems

Efficient Bayesian inference using physics-informed invertible neural networks for inverse problems

Non-centered Parametric Variational Bayes' Approach for Hierarchical Inverse Problems of Partial Differential Equations.

Variational Inference for Nonlinear Inverse Problems via Neural Net Kernels: Comparison to Bayesian Neural Networks, Application to Topology Optimization

Consistency of variational Bayesian inference for non-linear inverse problems of partial differential equations

Weak neural variational inference for solving Bayesian inverse problems without forward models: applications in elastography

A variational inference framework for inverse problems

Score-Based Variational Inference for Inverse Problems

An invariance constrained deep learning network for PDE discovery

Variational Gaussian Processes For Linear Inverse Problems

Generalized Bayes Approach to Inverse Problems with Model Misspecification

An invariance constrained deep learning network for partial differential equation discovery

Inversion of Integral Models: a Neural Network Approach

InVAErt networks: A data-driven framework for model synthesis and identifiability analysis

A Novel Method to Solve Inverse Variational Inequality Problems Based on Neural Networks

Efficient Bayesian Physics Informed Neural Networks for inverse problems via Ensemble Kalman Inversion

Variable coefficient-informed neural network for PDE inverse problem in fluid dynamics