Abstract:Monte Carlo (MC) sampling is a popular method for estimating the statistics (e.g. expectation and variance) of a random variable. Its slow convergence has led to the emergence of advanced techniques to reduce the variance of the MC estimator for the outputs of computationally expensive solvers. The control variates (CV) method corrects the MC estimator with a term derived from auxiliary random variables that are highly correlated with the original random variable. These auxiliary variables may come from surrogate models. Such a surrogate-based CV strategy is extended here to the multilevel Monte Carlo (MLMC) framework, which relies on a sequence of levels corresponding to numerical simulators with increasing accuracy and computational cost. MLMC combines output samples obtained across levels, into a telescopic sum of differences between MC estimators for successive fidelities. In this paper, we introduce three multilevel variance reduction strategies that rely on surrogate-based CV and MLMC. MLCV is presented as an extension of CV where the correction terms devised from surrogate models for simulators of different levels add up. MLMC-CV improves the MLMC estimator by using a CV based on a surrogate of the correction term at each level. Further variance reduction is achieved by using the surrogate-based CVs of all the levels in the MLMC-MLCV strategy. Alternative solutions that reduce the subset of surrogates used for the multilevel estimation are also introduced. The proposed methods are tested on a test case from the literature consisting of a spectral discretization of an uncertain 1D heat equation, where the statistic of interest is the expected value of the integrated temperature along the domain at a given time. The results are assessed in terms of the accuracy and computational cost of the multilevel estimators, depending on whether the construction of the surrogates, and the associated computational cost, precede the evaluation of the estimator. It was shown that when the lower fidelity outputs are strongly correlated with the high-fidelity outputs, a significant variance reduction is obtained when using surrogate models for the coarser levels only. It was also shown that taking advantage of pre-existing surrogate models proves to be an even more efficient strategy.

Multilevel Monte Carlo and its Applications in Financial Engineering

Multilevel Monte Carlo in Sample Average Approximation: Convergence, Complexity and Application

Improved adaptive Multilevel Monte Carlo and applications to finance

An Introduction to Multilevel Monte Carlo for Option Valuation

Multilevel Monte Carlo with Numerical Smoothing for Robust and Efficient Computation of Probabilities and Densities

Multilevel Monte Carlo methods for stochastic convection-diffusion eigenvalue problems

Gradient-based optimisation of the conditional-value-at-risk using the multi-level Monte Carlo method

A weighted multilevel Monte Carlo method

Sub-sampling and other considerations for efficient risk estimation in large portfolios

Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models

Three Improvements to Multi-Level Monte Carlo Simulation of SDE Systems

Multilevel Monte Carlo for Reliability Theory

Nested Multilevel Monte Carlo with Biased and Antithetic Sampling

Monte Carlo Simulation in Financial Engineering

Multilevel Surrogate-based Control Variates

Antithetic Multilevel Methods for Elliptic and Hypo-Elliptic Diffusions with Applications

Some Contributions to Sequential Monte Carlo Methods for Option Pricing

A Massively Parallel Implementation of Multilevel Monte Carlo for Finite Element Models

Single-ensemble multilevel Monte Carlo for discrete interacting-particle methods

Estimating option prices using multilevel particle filters

Multilevel Monte Carlo methods for positivity-preserving approximations of the Heston 3/2-model