Abstract:Data-driven approaches coupled with physical knowledge are powerful techniques to model systems. The goal of such models is to efficiently solve for the underlying field by combining measurements with known physical laws. As many systems contain unknown elements, such as missing parameters, noisy data, or incomplete physical laws, this is widely approached as an uncertainty quantification problem. The common techniques to handle all the variables typically depend on the numerical scheme used to approximate the posterior, and it is desirable to have a method which is independent of any such discretization. Information field theory (IFT) provides the tools necessary to perform statistics over fields that are not necessarily Gaussian. We extend IFT to physics-informed IFT (PIFT) by encoding the functional priors with information about the physical laws which describe the field. The posteriors derived from this PIFT remain independent of any numerical scheme and can capture multiple modes, allowing for the solution of problems which are ill-posed. We demonstrate our approach through an analytical example involving the Klein-Gordon equation. We then develop a variant of stochastic gradient Langevin dynamics to draw samples from the joint posterior over the field and model parameters. We apply our method to numerical examples with various degrees of model-form error and to inverse problems involving nonlinear differential equations. As an addendum, the method is equipped with a metric which allows the posterior to automatically quantify model-form uncertainty. Because of this, our numerical experiments show that the method remains robust to even an incorrect representation of the physics given sufficient data. We numerically demonstrate that the method correctly identifies when the physics cannot be trusted, in which case it automatically treats learning the field as a regression problem.

Uncertainty quantification for learned ISTA

Total Uncertainty Quantification in Inverse PDE Solutions Obtained with Reduced-Order Deep Learning Surrogate Models

Hybrid ISTA: Unfolding ISTA With Convergence Guarantees Using Free-Form Deep Neural Networks

Variational Learning ISTA

On the Quantification of Image Reconstruction Uncertainty without Training Data

Non-Asymptotic Uncertainty Quantification in High-Dimensional Learning

Uncertainty quantification for deep learning-based schemes for solving high-dimensional backward stochastic differential equations

Uncertainty Quantification for Deep Learning

Nonlinear Expectation Inference for Direct Uncertainty Quantification of Nonlinear Inverse Problems

Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantification

Neural State-Space Models: Empirical Evaluation of Uncertainty Quantification

Quantification of Predictive Uncertainty via Inference-Time Sampling

Quantifying Epistemic Uncertainty in Deep Learning

Uncertainty Quantification in Deep Neural Networks through Statistical Inference on Latent Space

Evaluation of Uncertainty Quantification in Deep Learning

Uncertainty Quantification for Sparse Deep Learning

Uncertainty Calibrations of Deep-Learning Schemes for Full-Wave Inverse Scattering Problems

Uncertainty quantification in imaging and automatic horizon tracking: a Bayesian deep-prior based approach

Recent Trends in the Modeling and Quantification of Non-probabilistic Uncertainty

A two-step surrogate method for sequential uncertainty quantification in high-dimensional inverse problems

Uncertainty Quantification for Forward and Inverse Problems of PDEs via Latent Global Evolution