Abstract:To sample from a given target distribution, Markov chain Monte Carlo (MCMC) sampling relies on constructing an ergodic Markov chain with the target distribution as its invariant measure. For any MCMC method, an important question is how to evaluate its efficiency. One approach is to consider the associated empirical measure and how fast it converges to the stationary distribution of the underlying Markov process. Recently, this question has been considered from the perspective of large deviation theory, for different types of MCMC methods, including, e.g., non-reversible Metropolis-Hastings on a finite state space, non-reversible Langevin samplers, the zig-zag sampler, and parallell tempering. This approach, based on large deviations, has proven successful in analysing existing methods and designing new, efficient ones. However, for the Metropolis-Hastings algorithm on more general state spaces, the workhorse of MCMC sampling, the same techniques have not been available for analysing performance, as the underlying Markov chain dynamics violate the conditions used to prove existing large deviation results for empirical measures of a Markov chain. This also extends to methods built on the same idea as Metropolis-Hastings, such as the Metropolis-Adjusted Langevin Method or ABC-MCMC. In this paper, we take the first steps towards such a large-deviations based analysis of Metropolis-Hastings-like methods, by proving a large deviation principle for the the empirical measures of Metropolis-Hastings chains. In addition, we characterize the rate function and its properties in terms of the acceptance- and rejection-part of the Metropolis-Hastings dynamics.

ON THE LARGE DEVIATION FUNCTIONS OF MARKOV CHAINS

On The Increments Of L(Infinity)-Valued Gaussian Processes

Functional limit theorem for moving average processes generated by dependent random variables

Large deviations and related problems for absorbing Markov chains

Large Deviations for Markov Chains and Spectrum of Matrices

Large Deviations for Empirical Measures of Self-Interacting Markov Chains

Large Deviations for Inhomogeneous Systems

Large Deviation Theorem for Empirical Measures of Degenerate Diffusion Processes

Some Strong Deviation Theorems for Two Orders Markov Chains on a Kind of Non-homogeneous Tree

Rate Function of Large Deviation for A Class of Nonhomogeneous Markov Chains on Supercritical Percolation Network

On the large deviation principle for Metropolis-Hastings Markov Chains: the Lyapunov function condition and examples

Large deviations for some dependent heavy tailed random sequences

On large deviation regimes for random media models

Central Limit Theorem and Moderate deviation for nonhomogenenous Markov chains

Large Deviations for Some Dependent Sequences

Exact Moderate and Large Deviations for Linear Processes

LARGE DEVIATIONS FOR A HEAVY-TAILED STATIONARY SEQUENCE

On regularity of functions of Markov chains

Large Deviations for High Minima of Gaussian Processes with Nonnegatively Correlated Increments

A class of strong deviation theorems for the sequence of real valued random variables with respect to continuous-state non-homogeneous Markov chains

A large deviation principle for the empirical measures of Metropolis-Hastings chains