Abstract:Convex relaxations based on different hierarchies of linear/semi-definite programs have been used recently to devise approximation algorithms for various optimization problems. The approximation guarantee of these algorithms improves with the number of {\em rounds} $r$ in the hierarchy, though the complexity of solving (or even writing down the solution for) the $r$'th level program grows as $n^{\Omega(r)}$ where $n$ is the input size. In this work, we observe that many of these algorithms are based on {\em local} rounding procedures that only use a small part of the SDP solution (of size $n^{O(1)} 2^{O(r)}$ instead of $n^{\Omega(r)}$). We give an algorithm to find the requisite portion in time polynomial in its size. The challenge in achieving this is that the required portion of the solution is not fixed a priori but depends on other parts of the solution, sometimes in a complicated iterative manner. Our solver leads to $n^{O(1)} 2^{O(r)}$ time algorithms to obtain the same guarantees in many cases as the earlier $n^{O(r)}$ time algorithms based on $r$ rounds of the Lasserre hierarchy. In particular, guarantees based on $O(\log n)$ rounds can be realized in polynomial time. We develop and describe our algorithm in a fairly general abstract framework. The main technical tool in our work, which might be of independent interest in convex optimization, is an efficient ellipsoid algorithm based separation oracle for convex programs that can output a {\em certificate of infeasibility with restricted support}. This is used in a recursive manner to find a sequence of consistent points in nested convex bodies that "fools" local rounding algorithms.

The Fun is Finite: Douglas-Rachford and Sudoku Puzzle – Finite Termination and Local Linear Convergence

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

On the finite convergence of the Douglas-Rachford algorithm for solving (not necessarily convex) feasibility problems in Euclidean spaces

Problem Solving at the Edge of Chaos: Entropy, Puzzles and the Sudoku Freezing Transition

Finding magic squares with the Douglas-Rachford algorithm

On the local convergence of the Douglas-Rachford algorithm

The linear system for Sudoku and a fractional completion threshold

Randomized Douglas–Rachford Methods for Linear Systems: Improved Accuracy and Efficiency

Local and Global Behavior for Algorithms of Solving Equations

Extremal and monotone behaviour of the Sudoku number and related critical set parameters

A stochastic preconditioned Douglas-Rachford splitting method for saddle-point problems

Convergence of the Preconditioned Proximal Point Method and Douglas-Rachford Splitting in the Absence of Monotonicity

Faster SDP hierarchy solvers for local rounding algorithms

A Warm Restart Strategy for Solving Sudoku by Sparse Optimization Methods

Convergence depth control for interior point methods

Randomized Douglas-Rachford methods for linear systems: Improved accuracy and efficiency

Heuristic Reasoning on Graph and Game Complexity of Sudoku

Graph and Distributed Extensions of the Douglas–Rachford Method

Exact Method for Generating Strategy-Solvable Sudoku Clues

A Unified Analysis of Stochastic Optimization Methods Using Jump System Theory and Quadratic Constraints

Tight Lower Complexity Bounds for Strongly Convex Finite-Sum Optimization