Uncertainty Quantification and Propagation in Surrogate-based Bayesian Inference

Philipp Reiser,Javier Enrique Aguilar,Anneli Guthke,Paul-Christian Bürkner

2024-07-23

Abstract:Surrogate models are statistical or conceptual approximations for more complex simulation models. In this context, it is crucial to propagate the uncertainty induced by limited simulation budget and surrogate approximation error to predictions, inference, and subsequent decision-relevant quantities. However, quantifying and then propagating the uncertainty of surrogates is usually limited to special analytic cases or is otherwise computationally very expensive. In this paper, we propose a framework enabling a scalable, Bayesian approach to surrogate modeling with thorough uncertainty quantification, propagation, and validation. Specifically, we present three methods for Bayesian inference with surrogate models given measurement data. This is a task where the propagation of surrogate uncertainty is especially relevant, because failing to account for it may lead to biased and/or overconfident estimates of the parameters of interest. We showcase our approach in three detailed case studies for linear and nonlinear real-world modeling scenarios. Uncertainty propagation in surrogate models enables more reliable and safe approximation of expensive simulators and will therefore be useful in various fields of applications.

Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to quantify and propagate uncertainties in Bayesian inference based on surrogate models. Specifically, the paper focuses on how to effectively handle the uncertainties caused by limited simulation budgets and surrogate model approximation errors when using surrogate models for parameter estimation. These problems are very important in practical applications because if these uncertainties are not properly considered, it may lead to biased or over - confident estimates of the parameters of interest. The paper proposes a framework that enables surrogate modeling in a scalable Bayesian approach and thoroughly quantifies, propagates, and validates uncertainties. In addition, the paper also introduces three methods for Bayesian inference using surrogate models given measurement data, which are particularly suitable for tasks that require the propagation of surrogate uncertainties. Through three detailed case studies, the application effects of the proposed framework in different real - world modeling scenarios are demonstrated.

Uncertainty Quantification and Propagation in Surrogate-based Bayesian Inference

A Surrogate Modelling Approach Based on Nonlinear Dimension Reduction for Uncertainty Quantification in Groundwater Flow Models

Bayesian Surrogate Analysis and Uncertainty Propagation

Recent Advances in Surrogate Modeling Methods for Uncertainty Quantification and Propagation

Surrogate-Based Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Structural Error.

Uncertainty Quantification of Surrogate Models using Conformal Prediction

A two-step surrogate method for sequential uncertainty quantification in high-dimensional inverse problems

Bayesian probabilistic propagation of hybrid uncertainties: Estimation of response expectation function, its variable importance and bounds

Hybrid uncertainty propagation based on multi-fidelity surrogate model

A Nonparametric Bayesian Framework for Uncertainty Quantification in Stochastic Simulation

Generalization of Non-Intrusive Imprecise Stochastic Simulation for Mixed Uncertain Variables

Bayesian Surrogate Training on Multiple Data Sources: A Hybrid Modeling Strategy

Surrogate-Based Bayesian Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Approximation Error

Probabilistic Surrogate Networks for Simulators with Unbounded Randomness

Statistics-based Bayesian Modeling Framework for Uncertainty Quantification and Propagation

Convergence Analysis of Surrogate-Based Methods for Bayesian Inverse Problems

Evaluating Two Sparse Grid Surrogates and Two Adaptation Criteria for Groundwater Bayesian Uncertainty Quantification

Uncertainty quantification by direct propagation of shallow ensembles

Uncertainty modeling and propagation for groundwater flow: a comparative study of surrogates

Application and Evaluation of Surrogate Models for Radiation Source Search

A Framework for Strategic Discovery of Credible Neural Network Surrogate Models under Uncertainty