Abstract:Message passing algorithms, whose iterative nature captures well complicated interactions among interconnected variables in complex systems and extracts information from the fixed point of iterated messages, provide a powerful toolkit in tackling hard computational tasks in optimization, inference, and learning problems. In the context of constraint satisfaction problems (CSPs), when a control parameter (such as constraint density) is tuned, multiple threshold phenomena emerge, signaling fundamental structural transitions in their solution space. Finding solutions around these transition points is exceedingly challenging for algorithm design, where message passing algorithms suffer from a large message fluctuation far from convergence. Here we introduce a residual-based updating step into message passing algorithms, in which messages varying large between consecutive steps are given high priority in the updating process. For the specific example of model RB, a typical prototype of random CSPs with growing domains, we show that our algorithm improves the convergence of message updating and increases the success probability in finding solutions around the satisfiability threshold with a low computational cost. Our approach to message passing algorithms should be of value for exploring their power in developing algorithms to find ground-state solutions and understand the detailed structure of solution space of hard optimization problems.

A Message-Passing Approach to Random Constraint Satisfaction Problems with Growing Domains

Analytical And Belief-Propagation Studies Of Random Constraint Satisfaction Problems With Growing Domains

A belief-propagation algorithm based on variable entropy for constraint satisfaction problems

A residual-based message passing algorithm for constraint satisfaction problems

Solution space structure of random constraint satisfaction problems with growing domains

The solution space structure of planted constraint satisfaction problems with growing domains

Balanced Random Constraint Satisfaction: Phase Transition and Hardness.

Consistency and Random Constraint Satisfaction Models

On the Scaling Window of Model RB

Local algorithms and the failure of log-depth quantum advantage on sparse random CSPs

Counting Solutions of Constraint Satisfiability Problems:Exact Phase Transitions and Approximate Algorithm

Biased landscapes for random Constraint Satisfaction Problems

The Satisfiability Threshold for a Seemingly Intractable Random Constraint Satisfaction Problem

Widely distributed clusters of the constraint satisfaction problem model d-k-CSP

Variable-Centered Consistency in Model RB

From K-Sat to K-Csp: Two Generalized Algorithms

Threshold behaviors of a random constraint satisfaction problem with exact phase transitions

Fractional Edge Cover Number of Model RB.

Conditional Random Fields, Planted Constraint Satisfaction, and Entropy Concentration

General Bounds on Satisfiability Thresholds for Random CSPs via Fourier Analysis

Unweighted Stochastic Local Search can be Effective for Random CSP Benchmarks