Abstract:Probabilistic graphical models, such as Markov random fields (MRFs), are useful for describing high-dimensional distributions in terms of local dependence structures. The probabilistic inference is a fundamental problem related to graphical models, and sampling is a main approach for the problem. In this paper, we study probabilistic inference problems when the graphical model itself is changing dynamically with time. Such dynamic inference problems arise naturally in today's application, e.g. multivariate time-series data analysis and practical learning procedures. We give a dynamic algorithm for sampling-based probabilistic inferences in MRFs, where each dynamic update can change the underlying graph and all parameters of the MRF simultaneously, as long as the total amount of changes is bounded. More precisely, suppose that the MRF has n variables and polylogarithmic-bounded maximum degree, and N(n) independent samples are sufficient for the inference for a polynomial function N(·). Our algorithm dynamically maintains an answer to the inference problem using O(n N(n)) space cost, and O(N(n) + n) incremental time cost upon each update to the MRF, as long as the well-known Dobrushin-Shlosman condition is satisfied by the MRFs. Compared to the static case, which requires Ω(n N(n)) time cost for redrawing all N(n) samples whenever the MRF changes, our dynamic algorithm gives a Ω(min{n, N(n)})-factor speedup. Our approach relies on a novel dynamic sampling technique, which transforms local Markov chains (a.k.a. single-site dynamics) to dynamic sampling algorithms, and an "algorithmic Lipschitz" condition that we establish for sampling from graphical models, namely, when the MRF changes by a small difference, samples can be modified to reflect the new distribution, with cost proportional to the difference on MRF.

Multilevel Belief Propagation for Fast Inference on Markov Random Fields

NeuroLifting: Neural Inference on Markov Random Fields at Scale

Block Belief Propagation for Parameter Learning in Markov Random Fields.

Hierarchical Belief Propagation on Image Segmentation Pyramid

SPM-BP: Sped-up PatchMatch Belief Propagation for Continuous MRFs

Neural Network Implementation of Inference on Binary Markov Random Fields with Probability Coding

Efficient Belief Propagation for Image Segmentation Based on an Adaptive MRF Model

Low complexity sparse Bayesian learning using combined belief propagation and mean field with a stretched factor graph.

Inference With Aggregate Data in Probabilistic Graphical Models: An Optimal Transport Approach

A Mean-Field Approximation Based BP Algorithm for Solving the Stochastic Block Model

Dynamic Inference in Probabilistic Graphical Models

Online Inference Based on Approximate Factors for Probabilistic Knowledge Bases

A Globally Convergent Mean-Field Inference Method in Dense Markov Random Fields

Fast Computation of Stationary Joint Probability Distribution of Sparse Markov Chains

Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models

Efficient MCMC for Gibbs Random Fields using pre-computation

Belief Propagation Neural Networks

An improved belief propagation algorithm for detecting meso-scale structure in complex networks

Deep Attentive Belief Propagation: Integrating Reasoning and Learning for Solving Constraint Optimization Problems

Fast Multilevel Transduction On Graphs

Neuralizing Efficient Higher-order Belief Propagation