Abstract:Linear partial differential equations (PDEs) are an important, widely applied class of mechanistic models, describing physical processes such as heat transfer, electromagnetism, and wave propagation. In practice, specialized numerical methods based on discretization are used to solve PDEs. They generally use an estimate of the unknown model parameters and, if available, physical measurements for initialization. Such solvers are often embedded into larger scientific models with a downstream application and thus error quantification plays a key role. However, by ignoring parameter and measurement uncertainty, classical PDE solvers may fail to produce consistent estimates of their inherent approximation error. In this work, we approach this problem in a principled fashion by interpreting solving linear PDEs as physics-informed Gaussian process (GP) regression. Our framework is based on a key generalization of the Gaussian process inference theorem to observations made via an arbitrary bounded linear operator. Crucially, this probabilistic viewpoint allows to (1) quantify the inherent discretization error; (2) propagate uncertainty about the model parameters to the solution; and (3) condition on noisy measurements. Demonstrating the strength of this formulation, we prove that it strictly generalizes methods of weighted residuals, a central class of PDE solvers including collocation, finite volume, pseudospectral, and (generalized) Galerkin methods such as finite element and spectral methods. This class can thus be directly equipped with a structured error estimate. In summary, our results enable the seamless integration of mechanistic models as modular building blocks into probabilistic models by blurring the boundaries between numerical analysis and Bayesian inference.

PDE-constrained Gaussian process surrogate modeling with uncertain data locations

A Surrogate Modelling Approach Based on Nonlinear Dimension Reduction for Uncertainty Quantification in Groundwater Flow Models

An Adaptive Gaussian Process‐based Method for Efficient Bayesian Experimental Design in Groundwater Contaminant Source Identification Problems

Gaussian process regression + deep neural network autoencoder for probabilistic surrogate modeling in nonlinear mechanics of solids

Gaussian Process Regression and Conditional Polynomial Chaos for Parameter Estimation

Bayesian learning with Gaussian processes for low-dimensional representations of time-dependent nonlinear systems

Conformal Approach To Gaussian Process Surrogate Evaluation With Coverage Guarantees

Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solvers

Uncertainty Quantification of Surrogate Models using Conformal Prediction

Bayesian Surrogate Analysis and Uncertainty Propagation

Variational Bayesian surrogate modelling with application to robust design optimisation

A New Surrogate Modeling Method Combining Polynomial Chaos Expansion And Gaussian Kernel In A Sparse Bayesian Learning Framework

A two-step surrogate method for sequential uncertainty quantification in high-dimensional inverse problems

Evaluating Two Sparse Grid Surrogates and Two Adaptation Criteria for Groundwater Bayesian Uncertainty Quantification

A hybrid data driven-physics constrained Gaussian process regression framework with deep kernel for uncertainty quantification

Introduction To Gaussian Process Regression In Bayesian Inverse Problems, With New ResultsOn Experimental Design For Weighted Error Measures

Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equations

Total Uncertainty Quantification in Inverse PDE Solutions Obtained with Reduced-Order Deep Learning Surrogate Models

An adaptive Gaussian process method for multi-modal Bayesian inverse problems

Gaussian Process Modelling for Uncertainty Quantification in Convectively-Enhanced Dissolution Processes in Porous Media

On the Inference of Applying Gaussian Process Modeling to a Deterministic Function