Abstract:The classical approaches to numerically integrating a function $f$ are Monte Carlo (MC) and quasi-Monte Carlo (QMC) methods. MC methods use random samples to evaluate $f$ and have error $O(\sigma(f)/\sqrt{n})$, where $\sigma(f)$ is the standard deviation of $f$. QMC methods are based on evaluating $f$ at explicit point sets with low discrepancy, and as given by the classical Koksma-Hlawka inequality, they have error $\widetilde{O}(\sigma_{\mathsf{HK}}(f)/n)$, where $\sigma_{\mathsf{HK}}(f)$ is the variation of $f$ in the sense of Hardy and Krause. These two methods have distinctive advantages and shortcomings, and a fundamental question is to find a method that combines the advantages of both. In this work, we give a simple randomized algorithm that produces QMC point sets with the following desirable features: (1) It achieves substantially better error than given by the classical Koksma-Hlawka inequality. In particular, it has error $\widetilde{O}(\sigma_{\mathsf{SO}}(f)/n)$, where $\sigma_{\mathsf{SO}}(f)$ is a new measure of variation that we introduce, which is substantially smaller than the Hardy-Krause variation. (2) The algorithm only requires random samples from the underlying distribution, which makes it as flexible as MC. (3) It automatically achieves the best of both MC and QMC (and the above improvement over Hardy-Krause variation) in an optimal way. (4) The algorithm is extremely efficient, with an amortized $\widetilde{O}(1)$ runtime per sample. Our method is based on the classical transference principle in geometric discrepancy, combined with recent algorithmic innovations in combinatorial discrepancy that besides producing low-discrepancy colorings, also guarantee certain subgaussian properties. This allows us to bypass several limitations of previous works in bridging the gap between MC and QMC methods and go beyond the Hardy-Krause variation.

Convergence of sequential quasi-Monte Carlo smoothing algorithms

Sequential quasi-Monte Carlo: Introduction for Non-Experts, Dimension Reduction, Application to Partly Observed Diffusion Processes

A new quasi-Monte Carlo filtering algorithm based on number theoretical method

Discussion of "Sequential Quasi-Monte-Carlo Sampling" by M. Gerber and N. Chopin

On sequential Monte Carlo sampling methods for Bayesian filtering

Sequential Monte Carlo with Highly Informative Observations

Discussion of "Sequential Quasi-Monte Carlo" by Mathieu Gerber and Nicolas Chopin

Achieving High Convergence Rates by Quasi-Monte Carlo and Importance Sampling for Unbounded Integrands

An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo

Higher order QMC Galerkin discretization for parametric operator equations

Quasi-Monte Carlo particle filter algorithm based on sigma point H∞

Particle rejuvenation of Rao-Blackwellized Sequential Monte Carlo smoothers for Conditionally Linear and Gaussian models

Accurate Smoothing Methods for State Estimation of Continuous-Discrete Nonlinear Dynamic Systems

Stratification and Optimal Resampling for Sequential Monte Carlo

Quasi-Monte Carlo Beyond Hardy-Krause

Forward Propagation of Low Discrepancy Through McKean-Vlasov Dynamics: From QMC to MLQMC

Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms

Bayesian Conditional Monte Carlo Algorithms for Sequential Single and Multi-Object filtering

A Smoothing Direct Search Method for Monte Carlo-Based Bound Constrained Composite Nonsmooth Optimization.

Multiresolutional Quasi-Monte Carlo-based Particle Filters

Ballistic Target Tracking Based on Quasi-Monte Carlo Filtering