Abstract:Belief propagation (BP) approaches, such as Max-sum and its variants, are important methods to solve large-scale Distributed Constraint Optimization Problems. However, these algorithms face a huge challenge since their computational complexity scales exponentially with the arity of each constraint function. Current accelerating techniques for BP use sorting or branch-and-bound (BnB) strategy to reduce the search space. However, the existing BnB-based methods are mainly designed for specific problems, which limits their applicability. On the other hand, though several generic sorting-based methods have been proposed, they require significantly high preprocessing as well as memory overhead, which prohibits their adoption in some realistic scenarios. In this paper, we aim to propose a series of generic and memory-efficient heuristic search techniques to accelerate belief propagation. Specifically, by leveraging dynamic programming, we efficiently build function estimations for every partial assignment scoped in a constraint function in the preprocessing phase. Then, by using these estimations to build upper bounds and employing a branch-and-bound in a depth-first fashion to reduce the search space, we propose our first method called FDSP. Next, we enhance FDSP by adapting a concurrent-search strategy and leveraging the upper bounds as guiding information and propose its first heuristic variant framework called CONC-FDSP. Finally, by choosing to expand the partial assignment with the highest upper bound in each step of exploration, we propose the second heuristic variant of FDSP, called BFS-FDSP. We prove the correctness of our methods theoretically, and our empirical evaluations indicate their superiority for accelerating Max-sum in terms of both time and memory, compared with the state-of-the-art.

A self-adaptive hierarchical belief propagation algorithm

A Hybrid Message-Passing Belief Propagation Algorithm

An Expectation Propagation Perspective on Approximate Message Passing

Fast Algorithm for Adaptive Generalized Predictive Control Based on Bp Neural Networks

An adaptive belief propagation algorithm combining the bit flipping method

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Belief Propagation with Optimized Pool Size for Non-Adaptive Group Testing: an Empirical Study

A Neural Network Empowered Belief Propagation Algorithm Optimized for Short-Cycles in Tanner Graph

Recursive Belief Propagation --- Belief Propagation in a Well-order

An Efficient Adaptive Degree-Based Heuristic Algorithm for Influence Maximization in Hypergraphs

Understanding belief propagation and its generalizations

Deep Attentive Belief Propagation: Integrating Reasoning and Learning for Solving Constraint Optimization Problems

Adaptive Back-Propagation Algorithm with Magnified Error Signals

Communication-Efficient Parallel Belief Propagation for Latent Dirichlet Allocation

Circular Belief Propagation for Approximate Probabilistic Inference

Cubature belief propagation for self-localization of wireless networks

Message Scheduling for Performant, Many-Core Belief Propagation

A Simple Insight into Iterative Belief Propagation's Success

Semi-supervised Hierarchical Optimization-Based Affinity Propagation Algorithm and Its Applications

Toward fast belief propagation for distributed constraint optimization problems via heuristic search

Convergent Message-Passing Algorithms for Inference over General Graphs with Convex Free Energies