Abstract:In this paper we examine the numerical approximation of the limiting invariant measure associated with Feynman-Kac formulae. These are expressed in a discrete time formulation and are associated with a Markov chain and a potential function. The typical application considered here is the computation of eigenvalues associated with non-negative operators as found, for example, in physics or particle simulation of rare-events. We focus on a novel \emph{lagged} approximation of this invariant measure, based upon the introduction of a ratio of time-averaged Feynman-Kac marginals associated with a positive operator iterated $l \in\mathbb{N}$ times; a lagged Feynman-Kac formula. This estimator and its approximation using Diffusion Monte Carlo (DMC) have been extensively employed in the physics literature. In short, DMC is an iterative algorithm involving $N\in\mathbb{N}$ particles or walkers simulated in parallel, that undergo sampling and resampling operations. In this work, it is shown that for the DMC approximation of the lagged Feynman-Kac formula, one has an almost sure characterization of the $\mathbb{L}_1$-error as the time parameter (iteration) goes to infinity and this is at most of $\mathcal{O}(\exp\{-\kappa l\}/N)$, for $\kappa>0$. In addition a non-asymptotic in time, and time uniform $\mathbb{L}_1-$bound is proved which is $\mathcal{O}(l/\sqrt{N})$. We also prove a novel central limit theorem to give a characterization of the exact asymptotic in time variance. This analysis demonstrates that the strategy used in physics, namely, to run DMC with $N$ and $l$ small and, for long time enough, is mathematically justified. Our results also suggest how one should choose $N$ and $l$ in practice. We emphasize that these results are not restricted to physical applications; they have broad relevance to the general problem of particle simulation of the Feynman-Kac formula.

Computing hitting times via fluid approximation: application to the coupon collector problem

Approximation Theorems Related to the Coupon Collector's Problem

On a generalisation of the coupon collector problem

Averaging over fast variables in the fluid limit for Markov chains: Application to the supermarket model with memory

On strong stationary times and approximation of Markov chain hitting times by geometric sums

Mixing Time of Glauber Dynamics With Parallel Updates and Heterogeneous Fugacities

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

Compound Poisson distributions for random dynamical systems using probabilistic approximations

A Unified Approach for Hitting Time of Jump Markov Type Processes

Strongly convergent homogeneous approximations to inhomogeneous Markov jump processes and applications

A note on the coupon - collector's problem with multiple arrivals and the random sampling

Drift, Minorization, and Hitting Times

The Bouncy Particle Sampler: A Nonreversible Rejection-Free Markov Chain Monte Carlo Method

A Stochastic Calculus Approach to Boltzmann Transport

Computing return times or return periods with rare event algorithms

Probabilistic limit behaviors of numerical discretizations for time-homogeneous Markov processes

On the Particle Approximation of Lagged Feynman-Kac Formulae

Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains

Almost Sure Diffusion Approximation in Averaging: Direct Proofs with Rough Paths Flavors