Abstract:By concisely representing a joint function of many variables as the combination of small functions, discrete graphical models (GMs) provide a powerful framework to analyze stochastic and deterministic systems of interacting variables. One of the main queries on such models is to identify the extremum of this joint function. This is known as the Weighted Constraint Satisfaction Problem (WCSP) on deterministic Cost Function Networks and as Maximum a Posteriori (MAP) inference on stochastic Markov Random Fields. Algorithms for approximate WCSP inference typically rely on local consistency algorithms or belief propagation. These methods are intimately related to linear programming (LP) relaxations and often coupled with reparametrizations defined by the dual solution of the associated LP. Since the seminal work of Goemans and Williamson, it is well understood that convex SDP relaxations can provide superior guarantees to LP. But the inherent computational cost of interior point methods has limited their application. The situation has improved with the introduction of non-convex Burer-Monteiro style methods which are well suited to handle the SDP relaxation of combinatorial problems with binary variables (such as MAXCUT, MaxSAT or MAP/Ising). We compute low rank SDP upper and lower bounds for discrete pairwise graphical models with arbitrary number of values and arbitrary binary cost functions by extending a Burer-Monteiro style method based on row-by-row updates. We consider a traditional dualized constraint approach and a dedicated Block Coordinate Descent approach which avoids introducing large penalty coefficients to the formulation. On increasingly hard and dense WCSP/CFN instances, we observe that the BCD approach can outperform the dualized approach and provide tighter bounds than local consistencies/convergent message passing approaches.

MADAM: A parallel exact solver for Max-Cut based on semidefinite programming and ADMM

Efficient Semidefinite Programming with approximate ADMM

An Efficient Inexact Symmetric Gauss-Seidel Based Majorized ADMM for High-Dimensional Convex Composite Conic Programming

Dealing with inequality constraints in large-scale semidefinite relaxations for graph coloring and maximum clique problems

An approximation algorithm for Maximum DiCut vs. Cut

A Parallel Method With Hybrid Algorithms For Mixed Integer Nonlinear Programming

An SU(2)-symmetric Semidefinite Programming Hierarchy for Quantum Max Cut

A Unified Algorithmic Framework of Symmetric Gauss-Seidel Decomposition Based Proximal ADMMs for Convex Composite Programming

SDPNAL+: A Matlab software for semidefinite programming with bound constraints (version 1.0)

Improved Approximation Algorithms for MAX

Benign landscape for Burer-Monteiro factorizations of MaxCut-type semidefinite programs

Fast ADMM for Sum-of-Squares Programs Using Partial Orthogonality.

Towards Scalable Semidefinite Programming: Optimal Metric ADMM with A Worst-case Performance Guarantee

Canonical Dual Approach to Solving the Maximum Cut Problem

A Newton-CG Augmented Lagrangian Method for Semidefinite Programming

A Hybrid Type ADMM for Multi-Block Separable Convex Programming

Efficient semidefinite bounds for multi-label discrete graphical models

Solving Euclidean Max-Sum problems exactly with cutting planes

The Ancestral Benders’ cutting plane algorithm with multi-term disjunctions for mixed-integer recourse decisions in stochastic programming

Global Optimization for Cardinality-constrained Minimum Sum-of-Squares Clustering via Semidefinite Programming

Maximizing Agreements for Ranking, Clustering and Hierarchical Clustering via MAX-CUT