Abstract:The Markov chain Monte Carlo (MCMC) methods are the primary tools for sampling from graphical models, e.g. Markov random fields (MRF). Traditional MCMC sampling algorithms are focused on a classic static setting, where the input is fixed. In this paper we study the problem of sampling from an MRF when the graphical model itself is changing dynamically with time. The problem is well motivated by the growing volume and velocity of data in today's applications of the MCMC methods. For the two major MCMC approaches, respectively for the approximate and perfect sampling, namely, the Gibbs sampling and the coupling from the past (CFTP), we give dynamic versions for the respective MCMC sampling algorithms. On MRF with $n$ variables and bounded maximum degrees, these dynamic sampling algorithms can maintain approximate or perfect samples, while the MRF is dynamically changing. Furthermore, our algorithms are efficient with $\tilde{O}(n)$ space cost, and $\tilde{O}(\log^2n)$ incremental time cost upon each local update to the input MRF, as long as certain decay conditions are satisfied in each step by natural couplings of the corresponding single-site chains. These decay conditions were well known in the literature of couplings for rapid mixing of Markov chains, and now for the first time, are used to imply efficient dynamic sampling algorithms. Consequently, we have efficient dynamic sampling algorithms for the following models: (1) general MRF satisfying the Dobrushin-Shlosman condition (for approximate sampling); (2) Ising model with temperature $\beta$ where $\mathrm{e}^{-2|\beta|}> 1-\frac{2}{\Delta+1}$ (for both approximate and perfect samplings); (3) hardcore model with fugacity $\lambda<\frac{2}{\Delta-2}$ (for both approximate and perfect samplings); (4) proper $q$-coloring with: $q>2\Delta$ (for approximate sampling); or $q>2\Delta^2+3\Delta$ (for perfect sampling).

A fresh take on 'Barker dynamics' for MCMC

Robust Approximate Sampling via Stochastic Gradient Barker Dynamics

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

Dynamic MCMC Sampling

Stochastic Gradient MCMC for Nonlinear State Space Models

Aggregated Gradient Langevin Dynamics

Stochastic Gradient Markov Chain Monte Carlo

An invitation to adaptive Markov chain Monte Carlo convergence theory

Markov Chain Monte Carlo for Continuous-Time Switching Dynamical Systems

Scalable MCMC for Mixed Membership Stochastic Blockmodels

Accelerated Markov Chain Monte Carlo Using Adaptive Weighting Scheme

An adaptive Hessian approximated stochastic gradient MCMC method

MCMC-driven learning

A fast asynchronous MCMC sampler for sparse Bayesian inference

De-randomizing MCMC dynamics with the diffusion Stein operator

Unbiased Markov chain quasi-Monte Carlo for Gibbs samplers

A Comparison of Variational and Markov Chain Monte Carlo Methods for Inference in Partially Observed Stochastic Dynamic Systems

Markov Chain Monte Carlo and Variational Inference: Bridging the Gap

Skew-symmetric schemes for stochastic differential equations with non-Lipschitz drift: an unadjusted Barker algorithm

Exact Langevin Dynamics with Stochastic Gradients

Geometry and Dynamics for Markov Chain Monte Carlo