Abstract:We present an implementation of the cluster variational method (CVM) as a message passing algorithm. The kind of message passing algorithm used for CVM, usually named generalized belief propagation (GBP), is a generalization of the belief propagation algorithm in the same way that CVM is a generalization of the Bethe approximation for estimating the partition function. However, the connection between fixed points of GBP and the extremal points of the CVM free energy is usually not a one-to-one correspondence because of the existence of a gauge transformation involving the GBP messages. Our contribution is twofold. First, we propose a way of defining messages (fields) in a generic CVM approximation, such that messages arrive on a given region from all its ancestors, and not only from its direct parents, as in the standard parent-to-child GBP. We call this approach maximal messages. Second, we focus on the case of binary variables, reinterpreting the messages as fields enforcing the consistency between the moments of the local (marginal) probability distributions. We provide a precise rule to enforce all consistencies, avoiding any redundancy, that would otherwise lead to a gauge transformation on the messages. This moment matching method is gauge free, i.e., it guarantees that the resulting GBP is not gauge invariant. We apply our maximal messages and moment matching GBP to obtain an analytical expression for the critical temperature of the Ising model in general dimensions at the level of plaquette CVM. The values obtained outperform Bethe estimates, and are comparable with loop corrected belief propagation equations. The method allows for a straightforward generalization to disordered systems.

PROOF OF THE CONVERGENCE OF NATURAL ITERATION METHOD FOR THE CLUSTER VARIATION METHOD

Improvement of the Cluster‐Variation Method

On the Rate of Convergence by Generalized Baskakov Operators

Cluster Variation Method as a Theoretical Tool for the Study of Phase Transformation

An improvement of cluster variation method entropy functional for bcc alloys

Cluster variation method in statistical physics and probabilistic graphical models

Provable Convergence of Variational Monte Carlo Methods

Convergence Analysis of a Method for Variational Inclusions

An Improved CVM Entropy Functional for BCC Alloys

Thermodynamic self-consistency issues related to the Cluster Variation Method: The case of the BCC Cr–Fe (Chromium–Iron) system

APPLICATION OF TWO-PHASE AND ONE-PHASE CALCULATION IN THE CLUSTER VARIATION METHOD

A Conjecture on C-matrices of Cluster Algebras

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

A differential cluster variation method for analysis of spiniodal decomposition in alloys

Unified Approach for Cluster Variation Method Calculations of Phase Diagrams in Fcc Substitutional Alloys with Interstitial Species

Calculation of γ′/γ equilibrium phase compositions in nickel-base superalloys by cluster variation method

A Differential Cluster Variation Method for Analysis of Spinodal Decomposition in Alloys

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

On the Convergence of the Variational Iteration Method for Klein-Gordon Problems with Variable Coefficients II

A projector-based convergence proof of the Ginelli algorithm for covariant Lyapunov vectors

Gauge-free cluster variational method by maximal messages and moment matching