Abstract:By concisely representing a joint function of many variables as the combination of small functions, discrete graphical models (GMs) provide a powerful framework to analyze stochastic and deterministic systems of interacting variables. One of the main queries on such models is to identify the extremum of this joint function. This is known as the Weighted Constraint Satisfaction Problem (WCSP) on deterministic Cost Function Networks and as Maximum a Posteriori (MAP) inference on stochastic Markov Random Fields. Algorithms for approximate WCSP inference typically rely on local consistency algorithms or belief propagation. These methods are intimately related to linear programming (LP) relaxations and often coupled with reparametrizations defined by the dual solution of the associated LP. Since the seminal work of Goemans and Williamson, it is well understood that convex SDP relaxations can provide superior guarantees to LP. But the inherent computational cost of interior point methods has limited their application. The situation has improved with the introduction of non-convex Burer-Monteiro style methods which are well suited to handle the SDP relaxation of combinatorial problems with binary variables (such as MAXCUT, MaxSAT or MAP/Ising). We compute low rank SDP upper and lower bounds for discrete pairwise graphical models with arbitrary number of values and arbitrary binary cost functions by extending a Burer-Monteiro style method based on row-by-row updates. We consider a traditional dualized constraint approach and a dedicated Block Coordinate Descent approach which avoids introducing large penalty coefficients to the formulation. On increasingly hard and dense WCSP/CFN instances, we observe that the BCD approach can outperform the dualized approach and provide tighter bounds than local consistencies/convergent message passing approaches.

Modeling Combinatorial Disjunctive Constraints via Junction Trees

Combinatorial Disjunctive Constraints for Obstacle Avoidance in Path Planning

A mixed-integer branching approach for very small formulations of disjunctive constraints

Integer Programming on the Junction Tree Polytope for Influence Diagrams

DisjunctiveProgramming.jl: Generalized Disjunctive Programming Models and Algorithms for JuMP

Efficient semidefinite bounds for multi-label discrete graphical models

Extensions to Generalized Disjunctive Programming: Hierarchical Structures and First-order Logic

Models and algorithms for simple disjunctive temporal problems

On SOCP-based disjunctive cuts for solving a class of integer bilevel nonlinear programs

Polyhedral-based Methods for Mixed-Integer SOCP in Tree Breeding

An Interleaved Depth-First Search Method for the Linear Optimization Problem with Disjunctive Constraints

Compact Disjunctive Approximations to Nonconvex Quadratically Constrained Programs

Computing Bipath Multicommodity Flows with Constraint Programming–Based Branch-and-Price-and-Cut

A Construction of Asymptotically Optimal Cascaded CDC Schemes via Combinatorial Designs

Constrained Shortest-Path Reformulations via Decision Diagrams for Structured Two-stage Optimization Problems

The Ancestral Benders’ cutting plane algorithm with multi-term disjunctions for mixed-integer recourse decisions in stochastic programming

Domain-Independent Dynamic Programming and Constraint Programming Approaches for Assembly Line Balancing Problems with Setups

The Boolean polynomial polytope with multiple choice constraints

Sub-Exponential Lower Bounds for Branch-and-Bound with General Disjunctions via Interpolation

Compiling Constraint Networks into AND/OR Multi-valued Decision Diagrams (AOMDDs)

Conjunctive Queries over Trees