Abstract:In this paper, we study the problem of sampling from a graphical model when the model itself is changing dynamically with time. This problem derives its interest from a variety of inference, learning, and sampling settings in machine learning, computer vision, statistical physics, and theoretical computer science. While the problem of sampling from a static graphical model has received considerable attention, theoretical works for its dynamic variants have been largely lacking. The main contribution of this paper is an algorithm that can sample dynamically from a broad class of graphical models over discrete random variables. Our algorithm is parallel and Las Vegas: it knows when to stop and it outputs samples from the exact distribution. We also provide sufficient conditions under which this algorithm runs in time proportional to the size of the update, on general graphical models as well as well-studied specific spin systems. In particular we obtain, for the Ising model (ferromagnetic or anti-ferromagnetic) and for the hardcore model the first dynamic sampling algorithms that can handle both edge and vertex updates (addition, deletion, change of functions), both efficient within regimes that are close to the respective uniqueness regimes, beyond which, even for the static and approximate sampling, no local algorithms were known or the problem itself is intractable. Our dynamic sampling algorithm relies on a local resampling algorithm and a new "equilibrium" property that is shown to be satisfied by our algorithm at each step, and enables us to prove its correctness. This equilibrium property is robust enough to guarantee the correctness of our algorithm, helps us improve bounds on fast convergence on specific models, and should be of independent interest.

Dynamic Sampling Procedure for Decomposable Random Networks

Efficient Learning for Decomposing and Optimizing Random Networks

Efficient Learning for Selecting Important Nodes in Random Network

Efficient Sampling Procedure for Selecting the Largest Stationary Probability of a Markov Chain

Decentralized Optimization with Edge Sampling

Bayesian Analysis for Exponential Random Graph Models Using the Adaptive Exchange Sampler.

Sampling Online Social Networks by Random Walk with Indirect Jumps

Evaluate Node Importance by Decomposing Network with a Recursive Percolation Process

Towards Cost-efficient Sampling Methods

Reliability of rank order in sampled networks

Tracking Influential Nodes in Dynamic Networks

MSNE: A Novel Markov Chain Sampling Strategy for Network Embedding.

Efficient and exact sampling of simple graphs with given arbitrary degree sequence

Fast Fault-Tolerant Sampling Via Random Walk in Dynamic Networks

Dynamic Sampling from Graphical Models.

Tracking Influential Individuals in Dynamic Networks

On the Impact of Random Node Sampling on Adaptive Diffusion Networks

Advanced Network Sampling with Heterogeneous Multiple Chains

Toward Cost-Efficient Sampling Methods

On sampling graphical Markov models