Abstract:The Markov chain Monte Carlo (MCMC) methods are the primary tools for sampling from graphical models, e.g. Markov random fields (MRF). Traditional MCMC sampling algorithms are focused on a classic static setting, where the input is fixed. In this paper we study the problem of sampling from an MRF when the graphical model itself is changing dynamically with time. The problem is well motivated by the growing volume and velocity of data in today's applications of the MCMC methods. For the two major MCMC approaches, respectively for the approximate and perfect sampling, namely, the Gibbs sampling and the coupling from the past (CFTP), we give dynamic versions for the respective MCMC sampling algorithms. On MRF with $n$ variables and bounded maximum degrees, these dynamic sampling algorithms can maintain approximate or perfect samples, while the MRF is dynamically changing. Furthermore, our algorithms are efficient with $\tilde{O}(n)$ space cost, and $\tilde{O}(\log^2n)$ incremental time cost upon each local update to the input MRF, as long as certain decay conditions are satisfied in each step by natural couplings of the corresponding single-site chains. These decay conditions were well known in the literature of couplings for rapid mixing of Markov chains, and now for the first time, are used to imply efficient dynamic sampling algorithms. Consequently, we have efficient dynamic sampling algorithms for the following models: (1) general MRF satisfying the Dobrushin-Shlosman condition (for approximate sampling); (2) Ising model with temperature $\beta$ where $\mathrm{e}^{-2|\beta|}> 1-\frac{2}{\Delta+1}$ (for both approximate and perfect samplings); (3) hardcore model with fugacity $\lambda<\frac{2}{\Delta-2}$ (for both approximate and perfect samplings); (4) proper $q$-coloring with: $q>2\Delta$ (for approximate sampling); or $q>2\Delta^2+3\Delta$ (for perfect sampling).

On sampling graphical Markov models

Importance Sampling of Interval Markov Chains

Reversible Mcmc on Markov Equivalence Classes of Sparse Directed Acyclic Graphs

Polynomial-Time Algorithms for Counting and Sampling Markov Equivalent DAGs with Applications

Markov Chain Sampling Methods for Dirichlet Process Mixture Models

Causal structure learning with momentum: Sampling distributions over Markov Equivalence Classes of DAGs

New Classes of Degree Sequences with Fast Mixing Swap Markov Chain Sampling

Uniform sampling of undirected and directed graphs with a fixed degree sequence

Perfect sampling from rapidly mixing Markov chains

Distributed Sampling Almost-Uniform Graph Coloring with Fewer Colors

Bayesian Analysis for Exponential Random Graph Models Using the Adaptive Exchange Sampler.

The switch Markov chain for sampling irregular graphs

Interpretations of Cluster Sampling by Swendsen-Wang

Sampling and Filtering with Markov Chains

Graph-accelerated Markov Chain Monte Carlo using Approximate Samples

Dynamic MCMC Sampling

Locally Stationary Distributions: A Framework for Analyzing Slow-Mixing Markov Chains

The switch Markov chain for sampling irregular graphs and digraphs

A rapidly mixing Markov chain from any gapped quantum many-body system

Approximate Sampling of Graphs with Near-$P$-stable Degree Intervals

The importance Markov chain