Abstract:Nested integration problems arise in various scientific and engineering applications, including Bayesian experimental design, financial risk assessment, and uncertainty quantification. These nested integrals take the form $\int f\left(\int g(\bs{y},\bs{x})\di{}\bs{x}\right)\di{}\bs{y}$, for nonlinear $f$, making them computationally challenging, particularly in high-dimensional settings. Although widely used for single integrals, traditional Monte Carlo (MC) methods can be inefficient when encountering complexities of nested integration. This work introduces a novel multilevel estimator, combining deterministic and randomized quasi-MC (rQMC) methods to handle nested integration problems efficiently. In this context, the inner number of samples and the discretization accuracy of the inner integrand evaluation constitute the level. We provide a comprehensive theoretical analysis of the estimator, deriving error bounds demonstrating significant reductions in bias and variance compared with standard methods. The proposed estimator is particularly effective in scenarios where the integrand is evaluated approximately, as it adapts to different levels of resolution without compromising precision. We verify the performance of our method via numerical experiments, focusing on estimating the expected information gain of experiments. We further introduce a truncation scheme to address the eventual unboundedness of the experimental noise. When applied to Gaussian noise in the estimator, this truncation scheme renders the same computational complexity as in the bounded noise case up to multiplicative logarithmic terms. The results reveal that the proposed multilevel rQMC estimator outperforms existing MC and rQMC approaches, offering a substantial reduction in computational costs and offering a powerful tool for practitioners dealing with complex, nested integration problems across various domains.

Computing the variance of a conditional expectation via non-nested Monte Carlo

Estimating nested expectations without inner conditional sampling and application to value of information analysis

Estimating the Mean of a Non-Linear Function of Conditional Expectation

Smooth Nested Simulation: Bridging Cubic and Square Root Convergence Rates in High Dimensions

Unbiased Monte Carlo estimation for the expected value of partial perfect information

Multilevel randomized quasi-Monte Carlo estimator for nested integration

Efficient risk estimation via nested multilevel quasi-Monte Carlo simulation

Nested Multilevel Monte Carlo with Biased and Antithetic Sampling

Double-loop randomized quasi-Monte Carlo estimator for nested integration

A FAST Method for Nested Estimation

Efficient Risk Estimation Via Nested Sequential Simulation

Improved Convergence Rate of Nested Simulation with LSE on Sieve

Efficient exponential tilting with applications

Nested Simulation for Conditional Value-at-Risk with Discrete Losses

Randomly Shifted Lattice Rules with Importance Sampling and Applications

On the Variance of Single-Run Unbiased Stochastic Derivative Estimators.

Iterative algorithms for non-conditional and conditional simulation of Gaussian random vectors

Achieving High Convergence Rates by Quasi-Monte Carlo and Importance Sampling for Unbounded Integrands

Sufficient Conditions for Central Limit Theorems and Confidence Intervals for Randomized Quasi-Monte Carlo Methods

High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization

A non-asymptotic error analysis for parallel Monte Carlo estimation from many short Markov chains