Abstract:We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost models --- which are typically lower fidelity with unknown statistics --- are used to reduce the variance in statistical estimators relative to a MC estimator with equivalent cost. We derive the conditions under which our proposed approximate control variate framework recovers existing multi-model variance reduction schemes as special cases. We demonstrate that these existing strategies use recursive sampling strategies, and as a result, their maximum possible variance reduction is limited to that of a control variate algorithm that uses only a single low-fidelity model with known mean. This theoretical result holds regardless of the number of low-fidelity models and/or samples used to build the estimator. We then derive new sampling strategies within our framework that circumvent this limitation to make efficient use of all available information sources. In particular, we demonstrate that a significant gap can exist, of orders of magnitude in some cases, between the variance reduction achievable by using a single low-fidelity model and our non-recursive approach. We also present initial sample allocation approaches for exploiting this gap. They yield the greatest benefit when augmenting the high-fidelity model evaluations is impractical because, for instance, they arise from a legacy database. Several analytic examples and an example with a hyperbolic PDE describing elastic wave propagation in heterogeneous media are used to illustrate the main features of the methodology.

Uncertainty Quantification for the BGK Model of the Boltzmann Equation Using Multilevel Variance Reduced Monte Carlo Methods

Multilevel Asymptotic-Preserving Monte Carlo for Particle Simulations

An Efficient Bayesian Uncertainty Quantification Approach with Application to K-Ω-γ Transition Modeling

Forward and Inverse Uncertainty Quantification using Multilevel Monte Carlo Algorithms for an Elliptic Nonlocal Equation

Spectral Convergence of a Semi-discretized Numerical System for the Spatially Homogeneous Boltzmann Equation with Uncertainties

On Stochastic Galerkin Approximation of the Nonlinear Boltzmann Equation with Uncertainty in the Fluid Regime

Quasi-Monte Carlo for partial differential equations with generalized Gaussian input uncertainty

A Generalized Approximate Control Variate Framework for Multifidelity Uncertainty Quantification

Multilevel higher order Quasi-Monte Carlo Bayesian Estimation

A stochastic Galerkin method for the Boltzmann equation with uncertainty

Multilevel and Multi-index Monte Carlo methods for the McKean-Vlasov equation

MIXED COVARIANCE FUNCTION KRIGING MODEL FOR UNCERTAINTY QUANTIFICATION

Multi-fidelity methods for uncertainty propagation in kinetic equations

Convergence of the Fourier-Galerkin spectral method for the Boltzmann equation with uncertainties

On the Multi-Species Boltzmann Equation with Uncertainty and Its Stochastic Galerkin Approximation

Multilevel Monte Carlo FDTD Method for Uncertainty Quantification

Inverse Uncertainty Quantification by Hierarchical Bayesian Modeling and Application in Nuclear System Thermal-Hydraulics Codes

Multilevel quadrature formulae for the optimal control of random PDEs

On multilevel Monte Carlo methods for deterministic and uncertain hyperbolic systems

Multi-Group Maximum Entropy Method: Modeling Translational Non-Equilibrium

Quantify uncertainty by estimating the probability density function of the output of interest using MLMC based Bayes method