Abstract:In general, Gaussian belief propagation (BP) is not guaranteed to converge in loopy graphs. But when Gaussian BP converges to a fixed point of its update equations, the exact means of the marginal distributions can be obtained. However, given a Gaussian graphical model, whether Gaussian BP would have fixed points is unknown. Moreover, the relation between the convergence of Gaussian BP and its fixed points is not clear. To answer these questions, the necessary and sufficient existence condition and an easily verifiable sufficient existence condition of fixed points of Gaussian BP are proposed. Conditioned on the existence of fixed points of Gaussian BP, the convergence conditions of outgoing messages' parameters are analyzed, where outgoing message denotes the message flowing from a variable node to a factor node on a factor graph. It is proved that outgoing messages' precisions (the reciprocal of variance) would converge if there exist fixed points for Gaussian BP. This provides an elegant interpretation of the convergence condition of outgoing messages' precisions. On the other hand, to guarantee the convergence of outgoing messages' means, a sufficient condition for Gaussian models with a single loop and a sufficient condition that can be checked without obtaining the converged outgoing messages' precisions are derived. The relations between the convergence conditions of outgoing messages' parameters and those of incoming messages' parameters are also revealed, making any convergence condition of outgoing messages valid for verifying the convergence of incoming messages. Numerical results are presented to corroborate the newly established theories.

Loop-corrected belief propagation for lattice spin models

An improved Belief Propagation algorithm finds many Bethe states in the random field Ising model on random graphs

Belief propagation algorithm for computing correlation functions in finite-temperature quantum many-body systems on loopy graphs

Loop Corrections in Spin Models through Density Consistency

Propagating beliefs in spin glass models

Loop calculus in statistical physics and information science

Inference algorithm for finite-dimensional spin glasses: belief propagation on the dual lattice

Belief propagation for general graphical models with loops

Generalized directed loop method for quantum Monte Carlo simulations

Belief-propagation algorithm and the Ising model on networks with arbitrary distributions of motifs

Understanding belief propagation and its generalizations

Loop braiding statistics in exactly soluble 3D lattice models

Fractional Propagation and the Elimination of Staggered Invariants in Lattice-BGK Models

Partition function loop series for a general graphical model: free energy corrections and message-passing equations

Loopy belief propagation for approximate inference: An empirical study

Loop corrections for hard spheres in Hamming space

Loop-Cluster Coupling and Algorithm for Classical Statistical Models

Fixing the Bethe approximation: How structural modifications in a graph improve belief propagation

Fixed Points of Gaussian Belief Propagation and Relation to Convergence

A Mean-Field Approximation Based BP Algorithm for Solving the Stochastic Block Model

Low complexity sparse Bayesian learning using combined belief propagation and mean field with a stretched factor graph.