Abstract:Belief propagation (BP) approaches, such as Max-sum and its variants, are important methods to solve large-scale Distributed Constraint Optimization Problems. However, these algorithms face a huge challenge since their computational complexity scales exponentially with the arity of each constraint function. Current accelerating techniques for BP use sorting or branch-and-bound (BnB) strategy to reduce the search space. However, the existing BnB-based methods are mainly designed for specific problems, which limits their applicability. On the other hand, though several generic sorting-based methods have been proposed, they require significantly high preprocessing as well as memory overhead, which prohibits their adoption in some realistic scenarios. In this paper, we aim to propose a series of generic and memory-efficient heuristic search techniques to accelerate belief propagation. Specifically, by leveraging dynamic programming, we efficiently build function estimations for every partial assignment scoped in a constraint function in the preprocessing phase. Then, by using these estimations to build upper bounds and employing a branch-and-bound in a depth-first fashion to reduce the search space, we propose our first method called FDSP. Next, we enhance FDSP by adapting a concurrent-search strategy and leveraging the upper bounds as guiding information and propose its first heuristic variant framework called CONC-FDSP. Finally, by choosing to expand the partial assignment with the highest upper bound in each step of exploration, we propose the second heuristic variant of FDSP, called BFS-FDSP. We prove the correctness of our methods theoretically, and our empirical evaluations indicate their superiority for accelerating Max-sum in terms of both time and memory, compared with the state-of-the-art.

An Improved Concurrent Search Algorithm for Distributed Csps

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

Improving Asynchronous Search for Distributed Generalized Assignment Problem

A Distributed Asynchronous Constraint Optimization Algorithm Based on Dynamic Reduction of Constraint Graph

An Estimation of Distribution Based Algorithm for Continuous Distributed Constraint Optimization Problems

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

A Unified Algorithmic Framework for Distributed Composite Optimization.

A Hybrid Discrete Cuckoo Search for Distributed Permutation Flowshop Scheduling Problem

Constrained Distributed Nonconvex Optimization over Time-varying Directed Graphs

Toward fast belief propagation for distributed constraint optimization problems via heuristic search

HS-CAI: A Hybrid DCOP Algorithm via Combining Search with Context-based Inference

A knowledge-driven cooperative scatter search algorithm with reinforcement learning for the distributed blocking flow shop scheduling problem

Distributed synchronous and asynchronous algorithms for semi-definite programming with diagonal constraints

Distributed Algorithms for Solving a Class of Convex Feasibility Problems

Effective constructive heuristics and discrete bee colony optimization for distributed flowshop with setup times

Distributed algorithms for solving the convex feasibility problems

An Optimal Block Knowledge Driven Backtracking Search Algorithm for Distributed Assembly No-wait Flow Shop Scheduling Problem

Distributed Synchronous and Asynchronous Algorithms for Semidefinite Programming With Diagonal Constraints

Collaborative variable neighborhood search for multi-objective distributed scheduling in two-stage hybrid flow shop with sequence-dependent setup times

Distributed consensus-based solver for semi-definite programming: An optimization viewpoint