Abstract:In this paper we propose a new approach for sampling from probability measures in, possibly, high dimensional spaces. By perturbing the standard overdamped Langevin dynamics by a suitable Stratonovich perturbation that preserves the invariant measure of the original system, we show that accelerated convergence to equilibrium and reduced asymptotic variance can be achieved, leading, thus, to a computationally advantageous sampling algorithm. The new perturbed Langevin dynamics is reversible with respect to the target probability measure and, consequently, does not suffer from the drawbacks of the nonreversible Langevin samplers that were introduced in~[C.-R. Hwang, S.-Y. Hwang-Ma, and S.-J. Sheu, Ann. Appl. Probab. 1993] and studied in, e.g. [T. Lelievre, F. Nier, and G. A. Pavliotis J. Stat. Phys., 2013] and [A. B. Duncan, T. Lelièvre, and G. A. Pavliotis J. Stat. Phys., 2016], while retaining all of their advantages in terms of accelerated convergence and reduced asymptotic variance. In particular, the reversibility of the dynamics ensures that there is no oscillatory transient behaviour. The improved performance of the proposed methodology, in comparison to the standard overdamped Langevin dynamics and its nonreversible perturbation, is illustrated on an example of sampling from a two-dimensional warped Gaussian target distribution.

Algorithms of Phase Space Reduction and Asymptotics of Hitting Times for Perturbed Semi-Markov Processes

Metastable Distributions of Semi-Markov Processes

Asymptotic Stability in Distribution of Nonlinear Stochastic Systems with Semi-Markovian Switching

Asymptotic properties for linear processes of functionals of reversible Markov Chains

Accelerated convergence to equilibrium and reduced asymptotic variance for Langevin dynamics using Stratonovich perturbations

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

Semi-Markov Processes in Open Quantum Systems. III. Large Deviations of First Passage Time Statistics

Probabilistic limit behaviors of numerical discretizations for time-homogeneous Markov processes

Strongly convergent homogeneous approximations to inhomogeneous Markov jump processes and applications

On a limit behavior of a sequence of Markov processes perturbed in a neighborhood of a singular point

A Unified Approach for Hitting Time of Jump Markov Type Processes

Limit theorems for infinite-dimensional piecewise deterministic Markov processes. Applications to stochastic excitable membrane models

Asymptotics of Harish-Chandra transform and infinitesimal freeness

Long-time asymptotics of stochastic reaction systems

Compound Poisson distributions for random dynamical systems using probabilistic approximations

The First-Passage Times of Phase Semi-Markov Processes

Asymptotic normality in multi-dimension of nonparametric estimators for discrete-time semi-Markov chains

On strong stationary times and approximation of Markov chain hitting times by geometric sums

Perturbation theory for killed Markov processes and quasi-stationary distributions

Stochastic generalized Kolmogorov systems with small diffusion: II. Explicit approximations for periodic solutions in distribution