Abstract:By concisely representing a joint function of many variables as the combination of small functions, discrete graphical models (GMs) provide a powerful framework to analyze stochastic and deterministic systems of interacting variables. One of the main queries on such models is to identify the extremum of this joint function. This is known as the Weighted Constraint Satisfaction Problem (WCSP) on deterministic Cost Function Networks and as Maximum a Posteriori (MAP) inference on stochastic Markov Random Fields. Algorithms for approximate WCSP inference typically rely on local consistency algorithms or belief propagation. These methods are intimately related to linear programming (LP) relaxations and often coupled with reparametrizations defined by the dual solution of the associated LP. Since the seminal work of Goemans and Williamson, it is well understood that convex SDP relaxations can provide superior guarantees to LP. But the inherent computational cost of interior point methods has limited their application. The situation has improved with the introduction of non-convex Burer-Monteiro style methods which are well suited to handle the SDP relaxation of combinatorial problems with binary variables (such as MAXCUT, MaxSAT or MAP/Ising). We compute low rank SDP upper and lower bounds for discrete pairwise graphical models with arbitrary number of values and arbitrary binary cost functions by extending a Burer-Monteiro style method based on row-by-row updates. We consider a traditional dualized constraint approach and a dedicated Block Coordinate Descent approach which avoids introducing large penalty coefficients to the formulation. On increasingly hard and dense WCSP/CFN instances, we observe that the BCD approach can outperform the dualized approach and provide tighter bounds than local consistencies/convergent message passing approaches.

Convex relaxation for the generalized maximum-entropy sampling problem

An outer-approximation algorithm for maximum-entropy sampling

The Augmented Factorization Bound for Maximum-Entropy Sampling

ADMM for 0/1 D-Opt and MESP relaxations

Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions

A Certifiably Globally Optimal Solution to Generalized Essential Matrix Estimation

Convex Relaxations for Subset Selection

Exponential Conic Relaxations for Signomial Geometric Programming

Efficient semidefinite bounds for multi-label discrete graphical models

Maximum Entropy Function Method for Nonconvex Optimization in Compressed Sensing

On generalized surrogate duality in mixed-integer nonlinear programming

Convex optimization over a probability simplex

Non-geodesically-convex optimization in the Wasserstein space

A Convex Optimization Approach to Generalized Moment Problems

Beyond Minimax Optimality: A Subgame Perfect Gradient Method

Convex Parameter Estimation of Perturbed Multivariate Generalized Gaussian Distributions

A Geometric Branch and Bound Method for a Class of Robust Maximization Problems of Convex Functions

A General Theory for Exact Sparse Representation Recovery in Convex Optimization

The Performance Analysis of Generalized Margin Maximizer (GMM) on Separable Data

A Stochastic GDA Method With Backtracking For Solving Nonconvex (Strongly) Concave Minimax Problems

Convexification of Permutation-Invariant Sets and an Application to Sparse Principal Component Analysis