Discussion of "Sequential Quasi-Monte Carlo" by Mathieu Gerber and Nicolas Chopin

Chris. J. Oates,Daniel Simpson,Mark Girolami

DOI: https://doi.org/10.48550/arXiv.1501.03386

2015-01-14

Computation

Abstract:A discussion on the possibility of reducing the variance of quasi-Monte Carlo estimators in applications. Further details are provided in the accompanying paper "Variance Reduction for Quasi-Monte Carlo".

What problem does this paper attempt to address?

Three discussions of the paper "sequential quasi-Monte Carlo sampling", by M. Gerber and N. Chopin

Julyan Arbel,Igor Prunster,Christian P. Robert,Robin J. Ryder

DOI: https://doi.org/10.1111/rssb.12104

2015-05-26

Abstract:This is a collection of three written discussions of the paper "sequential quasi-Monte Carlo sampling" by M. Gerber and N. Chopin, following the presentation given before the Royal Statistical Society in London on December 10th, 2014.

Computation
Discussion of "Sequential Quasi-Monte-Carlo Sampling" by M. Gerber and N. Chopin

M. Pollock,A.M. Johansen,K. Łatuszyński,G.O. Roberts

DOI: https://doi.org/10.48550/arXiv.1502.01194

2015-02-04

Abstract:In this comment we consider whether QMC methods can be further embedded within SMC schemes in settings in which the transition density of the latent process is intractable and pseudo-marginal methods are deployed.

Methodology
Variance Reduction Techniques and Quasi-Monte Carlo Methods

XQ Wang

DOI: https://doi.org/10.1016/s0377-0427(00)00331-9

IF: 2.872

2001-01-01

Journal of Computational and Applied Mathematics

Abstract:Quasi-Monte Carlo methods can be described as deterministic versions of Monte Carlo methods. Variance reduction techniques are widely used for improving the efficiency of Monte Carlo methods. In this paper, we study the possibility of using the deterministic versions of some variance reduction techniques for the variation reduction in the context of quasi-Monte Carlo methods. We combine the flexibility of Monte Carlo methods with the effectiveness and fast convergence of quasi-Monte Carlo methods. Quasi-random integration rules that integrate exactly some class of functions are constructed.
Convergence of sequential quasi-Monte Carlo smoothing algorithms

Mathieu Gerber,Nicolas Chopin

DOI: https://doi.org/10.3150/16-bej834

IF: 1.5

2017-11-02

Bernoulli

Abstract:Gerber and Chopin [J. R. Stat. Soc. Ser. B. Stat. Methodol. 77 (2015) 509–579] recently introduced Sequential quasi-Monte Carlo (SQMC) algorithms as an efficient way to perform filtering in state–space models. The basic idea is to replace random variables with low-discrepancy point sets, so as to obtain faster convergence than with standard particle filtering. Gerber and Chopin (2015) describe briefly several ways to extend SQMC to smoothing, but do not provide supporting theory for this extension. We discuss more thoroughly how smoothing may be performed within SQMC, and derive convergence results for the so-obtained smoothing algorithms. We consider in particular SQMC equivalents of forward smoothing and forward filtering backward sampling, which are the most well-known smoothing techniques. As a preliminary step, we provide a generalization of the classical result of Hlawka and Mück [Computing (Arch. Elektron. Rechnen) 9 (1972) 127–138] on the transformation of QMC point sets into low discrepancy point sets with respect to non uniform distributions. As a corollary of the latter, we note that we can slightly weaken the assumptions to prove the consistency of SQMC.

statistics & probability
Sequential quasi-Monte Carlo: Introduction for Non-Experts, Dimension Reduction, Application to Partly Observed Diffusion Processes

Nicolas Chopin,Mathieu Gerber

DOI: https://doi.org/10.48550/arXiv.1706.05305

2017-06-16

Abstract:SMC (Sequential Monte Carlo) is a class of Monte Carlo algorithms for filtering and related sequential problems. Gerber and Chopin (2015) introduced SQMC (Sequential quasi-Monte Carlo), a QMC version of SMC. This paper has two objectives: (a) to introduce Sequential Monte Carlo to the QMC community, whose members are usually less familiar with state-space models and particle filtering; (b) to extend SQMC to the filtering of continuous-time state-space models, where the latent process is a diffusion. A recurring point in the paper will be the notion of dimension reduction, that is how to implement SQMC in such a way that it provides good performance despite the high dimension of the problem.

Computation
Quasi-Monte Carlo Beyond Hardy-Krause

Nikhil Bansal,Haotian Jiang

2024-08-13

Abstract:The classical approaches to numerically integrating a function $f$ are Monte Carlo (MC) and quasi-Monte Carlo (QMC) methods. MC methods use random samples to evaluate $f$ and have error $O(\sigma(f)/\sqrt{n})$, where $\sigma(f)$ is the standard deviation of $f$. QMC methods are based on evaluating $f$ at explicit point sets with low discrepancy, and as given by the classical Koksma-Hlawka inequality, they have error $\widetilde{O}(\sigma_{\mathsf{HK}}(f)/n)$, where $\sigma_{\mathsf{HK}}(f)$ is the variation of $f$ in the sense of Hardy and Krause. These two methods have distinctive advantages and shortcomings, and a fundamental question is to find a method that combines the advantages of both. In this work, we give a simple randomized algorithm that produces QMC point sets with the following desirable features: (1) It achieves substantially better error than given by the classical Koksma-Hlawka inequality. In particular, it has error $\widetilde{O}(\sigma_{\mathsf{SO}}(f)/n)$, where $\sigma_{\mathsf{SO}}(f)$ is a new measure of variation that we introduce, which is substantially smaller than the Hardy-Krause variation. (2) The algorithm only requires random samples from the underlying distribution, which makes it as flexible as MC. (3) It automatically achieves the best of both MC and QMC (and the above improvement over Hardy-Krause variation) in an optimal way. (4) The algorithm is extremely efficient, with an amortized $\widetilde{O}(1)$ runtime per sample. Our method is based on the classical transference principle in geometric discrepancy, combined with recent algorithmic innovations in combinatorial discrepancy that besides producing low-discrepancy colorings, also guarantee certain subgaussian properties. This allows us to bypass several limitations of previous works in bridging the gap between MC and QMC methods and go beyond the Hardy-Krause variation.

Data Structures and Algorithms,Computational Geometry,Discrete Mathematics,Numerical Analysis
An invitation to sequential Monte Carlo samplers

Chenguang Dai,Jeremy Heng,Pierre E. Jacob,Nick Whiteley

DOI: https://doi.org/10.48550/arXiv.2007.11936

2022-06-17

Abstract:Statisticians often use Monte Carlo methods to approximate probability distributions, primarily with Markov chain Monte Carlo and importance sampling. Sequential Monte Carlo samplers are a class of algorithms that combine both techniques to approximate distributions of interest and their normalizing constants. These samplers originate from particle filtering for state space models and have become general and scalable sampling techniques. This article describes sequential Monte Carlo samplers and their possible implementations, arguing that they remain under-used in statistics, despite their ability to perform sequential inference and to leverage parallel processing resources among other potential benefits.

Computation,Methodology
Complexity analysis of quasi continuous level Monte Carlo

Cedric Beschle,Andrea Barth

DOI: https://doi.org/10.1051/m2an/2024039

2024-05-24

ESAIM: Mathematical Modelling and Numerical Analysis

Abstract:Continuous level Monte Carlo is an unbiased, continuous version of the celebrated multilevel Monte Carlo method. The approximation level is assumed to be continuous resulting in a stochastic process describing the quantity of interest. Continuous level Monte Carlo methods allow naturally for samplewise adaptive mesh refinements, which are indicated by (goal-oriented) error estimators. The samplewise refinement levels are drawn in the estimator from an exponentially-distributed random variable. Unfortunately in practical examples this results in higher costs due to high variance in the samples. In this paper we propose a variant of continuous level Monte Carlo, where a quasi Monte Carlo sequence is utilized to ''sample'' the exponential random variable. We provide a complexity theorem for this novel estimator and show that this theoretically and practically results in a variance reduction of the whole estimator.

mathematics, applied
Discrepancy estimates for variance bounding Markov chain quasi-Monte Carlo

Josef Dick,Daniel Rudolf

DOI: https://doi.org/10.1214/EJP.v19-3132

2014-12-03

Abstract:Markov chain Monte Carlo (MCMC) simulations are modeled as driven by true random numbers. We consider variance bounding Markov chains driven by a deterministic sequence of numbers. The star-discrepancy provides a measure of efficiency of such Markov chain quasi-Monte Carlo methods. We define a pull-back discrepancy of the driver sequence and state a close relation to the star-discrepancy of the Markov chain-quasi Monte Carlo samples. We prove that there exists a deterministic driver sequence such that the discrepancies decrease almost with the Monte Carlo rate $n^{1/2}$. As for MCMC simulations, a burn-in period can also be taken into account for Markov chain quasi-Monte Carlo to reduce the influence of the initial state. In particular, our discrepancy bound leads to an estimate of the error for the computation of expectations. To illustrate our theory we provide an example for the Metropolis algorithm based on a ball walk. Furthermore, under additional assumptions we prove the existence of a driver sequence such that the discrepancy of the corresponding deterministic Markov chain sample decreases with order $n^{-1+\delta}$ for every $\delta>0$.

Computation,Numerical Analysis,Statistics Theory
Error in Monte Carlo, quasi-error in Quasi-Monte Carlo

Ronald Kleiss,Achilleas Lazopoulos

DOI: https://doi.org/10.1016/j.cpc.2006.02.001

IF: 4.717

2006-07-01

Computer Physics Communications

Abstract:While the Quasi-Monte Carlo method of numerical integration achieves smaller integration error than standard Monte Carlo, its use in particle physics phenomenology has been hindered by the absence of a reliable way to estimate that error. The standard Monte Carlo error estimator relies on the assumption that the points are generated independently of each other and, therefore, fails to account for the error improvement advertised by the Quasi-Monte Carlo method. We advocate the construction of an estimator of stochastic nature, based on the ensemble of pointsets with a particular discrepancy value. We investigate the consequences of this choice and give some first empirical results on the suggested estimators.

physics, mathematical,computer science, interdisciplinary applications
Variance Reduction for Generalized Likelihood Ratio Method by Conditional Monte Carlo and Randomized Quasi-Monte Carlo Methods

Yijie Peng,Michael C. Fu,Jiaqiao Hu,Pierre L'Ecuyer,Bruno Tuffin

DOI: https://doi.org/10.1016/j.jmse.2022.02.002

2022-01-01

Journal of Management Science and Engineering

Abstract:The generalized likelihood ratio (GLR) method is a recently introduced gradient estimation method for handling discontinuities in a wide range of sample performances. We put the GLR methods from previous work into a single framework, simplify regularity conditions to justify the unbiasedness of GLR, and relax some of those conditions that are difficult to verify in practice. Moreover, we combine GLR with conditional Monte Carlo methods and randomized quasi-Monte Carlo methods to reduce the variance. Numerical experiments show that variance reduction could be significant in various applications.
Variance reduction for dependent sequences with applications to Stochastic Gradient MCMC

D. Belomestny,L. Iosipoi,E. Moulines,A. Naumov,S. Samsonov

DOI: https://doi.org/10.48550/arXiv.2008.06858

2020-08-16

Abstract:In this paper we propose a novel and practical variance reduction approach for additive functionals of dependent sequences. Our approach combines the use of control variates with the minimisation of an empirical variance estimate. We analyse finite sample properties of the proposed method and derive finite-time bounds of the excess asymptotic variance to zero. We apply our methodology to Stochastic Gradient MCMC (SGMCMC) methods for Bayesian inference on large data sets and combine it with existing variance reduction methods for SGMCMC. We present empirical results carried out on a number of benchmark examples showing that our variance reduction method achieves significant improvement as compared to state-of-the-art methods at the expense of a moderate increase of computational overhead.

Statistics Theory,Computation
Nonasymptotic Convergence Rate of Quasi-Monte Carlo: Applications to Linear Elliptic PDEs with Lognormal Coefficients and Importance Samplings

Yang Liu,Raúl Tempone

2024-08-18

Abstract:This study analyzes the nonasymptotic convergence behavior of the quasi-Monte Carlo (QMC) method with applications to linear elliptic partial differential equations (PDEs) with lognormal coefficients. Building upon the error analysis presented in (Owen, 2006), we derive a nonasymptotic convergence estimate depending on the specific integrands, the input dimensionality, and the finite number of samples used in the QMC quadrature. We discuss the effects of the variance and dimensionality of the input random variable. Then, we apply the QMC method with importance sampling (IS) to approximate deterministic, real-valued, bounded linear functionals that depend on the solution of a linear elliptic PDE with a lognormal diffusivity coefficient in bounded domains of $\mathbb{R}^d$, where the random coefficient is modeled as a stationary Gaussian random field parameterized by the trigonometric and wavelet-type basis. We propose two types of IS distributions, analyze their effects on the QMC convergence rate, and observe the improvements.

Numerical Analysis
Sufficient Conditions for Central Limit Theorems and Confidence Intervals for Randomized Quasi-Monte Carlo Methods

Marvin K. Nakayama,Bruno Tuffin

DOI: https://doi.org/10.1145/3643847

IF: 0.851

2024-02-14

ACM Transactions on Modeling and Computer Simulation

Abstract:Randomized quasi-Monte Carlo methods have been introduced with the main purpose of yielding a computable measure of error for quasi-Monte Carlo approximations through the implicit application of a central limit theorem over independent randomizations. But to increase precision for a given computational budget, the number of independent randomizations is usually set to a small value so that a large number of points are used from each randomized low-discrepancy sequence to benefit from the fast convergence rate of quasi-Monte Carlo. While a central limit theorem has been previously established for a specific but computationally expensive type of randomization, it is also known in general that fixing the number of randomizations and increasing the length of the sequence used for quasi-Monte Carlo can lead to a non-Gaussian limiting distribution. This paper presents sufficient conditions on the relative growth rates of the number of randomizations and the quasi-Monte Carlo sequence length to ensure a central limit theorem and also an asymptotically valid confidence interval. We obtain several results based on the Lindeberg condition for triangular arrays and expressed in terms of the regularity of the integrand and the convergence speed of the quasi-Monte Carlo method. We also analyze the resulting estimator’s convergence rate.

computer science, interdisciplinary applications,mathematics, applied
Quasi-Monte Carlo methods applied to tau-leaping in stochastic biological systems

Casper H. L. Beentjes,Ruth E. Baker

DOI: https://doi.org/10.1007/s11538-018-0442-2

2018-05-01

Abstract:Quasi-Monte Carlo methods have proven to be effective extensions of traditional Monte Carlo methods in, amongst others, problems of quadrature and the sample path simulation of stochastic differential equations. By replacing the random number input stream in a simulation procedure by a low-discrepancy number input stream, variance reductions of several orders have been observed in financial applications. Analysis of stochastic effects in well-mixed chemical reaction networks often relies on sample path simulation using Monte Carlo methods, even though these methods suffer from typical slow $\mathcal{O}(N^{-1/2})$ convergence rates as a function of the number of sample paths $N$. This paper investigates the combination of (randomised) quasi-Monte Carlo methods with an efficient sample path simulation procedure, namely $\tau$-leaping. We show that this combination is often more effective than traditional Monte Carlo simulation in terms of the decay of statistical errors. The observed convergence rate behaviour is, however, non-trivial due to the discrete nature of the models of chemical reactions. We explain how this affects the performance of quasi-Monte Carlo methods by looking at a test problem in standard quadrature.

Quantitative Methods
Multicanonical sequential Monte Carlo sampler for uncertainty quantification

Robert Millar,Hui Li,Jinglai Li

DOI: https://doi.org/10.1016/j.ress.2023.109316

2023-04-22

Abstract:In many real-world engineering systems, the performance or reliability of the system is characterised by a scalar variable. The distribution of this performance variable is important in many uncertainty quantification problems, ranging from risk management to utility optimisation. In practice, this distribution usually cannot be derived analytically and has to be obtained numerically by simulations. To this end, standard Monte Carlo simulations are often used, however, they cannot efficiently reconstruct the tail of the distribution which is essential in many applications. One possible remedy is to use the Multicanonical Monte Carlo method, an adaptive importance sampling scheme. In this method, one draws samples from an importance sampling distribution in a nonstandard form in each iteration, which is usually done via Markov chain Monte Carlo (MCMC). MCMC is inherently serial and therefore struggles with parallelism. In this paper, we present a new approach, which uses the Sequential Monte Carlo sampler to draw from the importance sampling distribution, which is particularly suited for parallel implementation. With both mathematical and practical examples, we demonstrate the competitive performance of the proposed method.

engineering, industrial,operations research & management science
Improving approximate Bayesian computation via quasi-Monte Carlo

Alexander Buchholz,Nicolas Chopin

DOI: https://doi.org/10.48550/arXiv.1710.01057

2018-05-07

Abstract:ABC (approximate Bayesian computation) is a general approach for dealing with models with an intractable likelihood. In this work, we derive ABC algorithms based on QMC (quasi- Monte Carlo) sequences. We show that the resulting ABC estimates have a lower variance than their Monte Carlo counter-parts. We also develop QMC variants of sequential ABC algorithms, which progressively adapt the proposal distribution and the acceptance threshold. We illustrate our QMC approach through several examples taken from the ABC literature. Keywords: Approximate Bayesian computation, Likelihood-free inference, Quasi Monte Carlo, Randomized Quasi-Monte Carlo, Adaptive importance sampling

Computation
Waste-free Sequential Monte Carlo

Hai-Dang Dau,Nicolas Chopin

DOI: https://doi.org/10.48550/arXiv.2011.02328

2021-08-23

Abstract:A standard way to move particles in a SMC sampler is to apply several steps of a MCMC (Markov chain Monte Carlo) kernel. Unfortunately, it is not clear how many steps need to be performed for optimal performance. In addition, the output of the intermediate steps are discarded and thus wasted somehow. We propose a new, waste-free SMC algorithm which uses the outputs of all these intermediate MCMC steps as particles. We establish that its output is consistent and asymptotically normal. We use the expression of the asymptotic variance to develop various insights on how to implement the algorithm in practice. We develop in particular a method to estimate, from a single run of the algorithm, the asymptotic variance of any particle estimate. We show empirically, through a range of numerical examples, that waste-free SMC tends to outperform standard SMC samplers, and especially so in situations where the mixing of the considered MCMC kernels decreases across iterations (as in tempering or rare event problems).

Computation
Markovian Foundations for Quasi-Stochastic Approximation in Two Timescales: Extended Version

Caio Kalil Lauand,Sean Meyn

2024-09-12

Abstract:Many machine learning and optimization algorithms can be cast as instances of stochastic approximation (SA). The convergence rate of these algorithms is known to be slow, with the optimal mean squared error (MSE) of order $O(n^{-1})$. In prior work it was shown that MSE bounds approaching $O(n^{-4})$ can be achieved through the framework of quasi-stochastic approximation (QSA); essentially SA with careful choice of deterministic exploration. These results are extended to two time-scale algorithms, as found in policy gradient methods of reinforcement learning and extremum seeking control. The extensions are made possible in part by a new approach to analysis, allowing for the interpretation of two timescale algorithms as instances of single timescale QSA, made possible by the theory of negative Lyapunov exponents for QSA. The general theory is illustrated with applications to extremum seeking control (ESC).

Optimization and Control
Digital Nets and Sequences for Quasi-Monte Carlo Methods

Hee Sun Hong

DOI: https://doi.org/10.48550/arXiv.2207.13802

2022-07-28

Abstract:Quasi-Monte Carlo methods are a way of improving the efficiency of Monte Carlo methods. Digital nets and sequences are one of the low discrepancy point sets used in quasi-Monte Carlo methods. This thesis presents the three new results pertaining to digital nets and sequences: implementing randomized digital nets, finding the distribution of the discrepancy of scrambled digital nets, and obtaining better quality of digital nets through evolutionary computation. Finally, applications of scrambled and non-scrambled digital nets are provided.

Numerical Analysis,Mathematical Software

Discussion of "Sequential Quasi-Monte Carlo" by Mathieu Gerber and Nicolas Chopin

Three discussions of the paper "sequential quasi-Monte Carlo sampling", by M. Gerber and N. Chopin

Discussion of "Sequential Quasi-Monte-Carlo Sampling" by M. Gerber and N. Chopin

Variance Reduction Techniques and Quasi-Monte Carlo Methods

Convergence of sequential quasi-Monte Carlo smoothing algorithms

Sequential quasi-Monte Carlo: Introduction for Non-Experts, Dimension Reduction, Application to Partly Observed Diffusion Processes

Quasi-Monte Carlo Beyond Hardy-Krause

An invitation to sequential Monte Carlo samplers

Complexity analysis of quasi continuous level Monte Carlo

Discrepancy estimates for variance bounding Markov chain quasi-Monte Carlo

Error in Monte Carlo, quasi-error in Quasi-Monte Carlo

Variance Reduction for Generalized Likelihood Ratio Method by Conditional Monte Carlo and Randomized Quasi-Monte Carlo Methods

Variance reduction for dependent sequences with applications to Stochastic Gradient MCMC

Nonasymptotic Convergence Rate of Quasi-Monte Carlo: Applications to Linear Elliptic PDEs with Lognormal Coefficients and Importance Samplings

Sufficient Conditions for Central Limit Theorems and Confidence Intervals for Randomized Quasi-Monte Carlo Methods

Quasi-Monte Carlo methods applied to tau-leaping in stochastic biological systems

Multicanonical sequential Monte Carlo sampler for uncertainty quantification

Improving approximate Bayesian computation via quasi-Monte Carlo

Waste-free Sequential Monte Carlo

Markovian Foundations for Quasi-Stochastic Approximation in Two Timescales: Extended Version

Digital Nets and Sequences for Quasi-Monte Carlo Methods