Abstract:The spectral bundle method developed by Helmberg and Rendl is well-established for solving large-scale semidefinite programs (SDPs) in the dual form, especially when the SDPs admit $\textit{low-rank primal solutions}$. Under mild regularity conditions, a recent result by Ding and Grimmer has established fast linear convergence rates when the bundle method captures $\textit{the rank of primal solutions}$. In this paper, we present an overview and comparison of spectral bundle methods for solving both $\textit{primal}$ and $\textit{dual}$ SDPs. In particular, we introduce a new family of spectral bundle methods for solving SDPs in the $\textit{primal}$ form. The algorithm developments are parallel to those by Helmberg and Rendl, mirroring the elegant duality between primal and dual SDPs. The new family of spectral bundle methods also achieves linear convergence rates for primal feasibility, dual feasibility, and duality gap when the algorithm captures $\textit{the rank of the dual solutions}$. Therefore, the original spectral bundle method by Helmberg and Rendl is well-suited for SDPs with $\textit{low-rank primal solutions}$, while on the other hand, our new spectral bundle method works well for SDPs with $\textit{low-rank dual solutions}$. These theoretical findings are supported by a range of large-scale numerical experiments. Finally, we demonstrate that our new spectral bundle method achieves state-of-the-art efficiency and scalability for solving polynomial optimization compared to a set of baseline solvers $\textsf{SDPT3}$, $\textsf{MOSEK}$, $\textsf{CDCS}$, and $\textsf{SDPNAL+}$.

A Two-Step Pre-Processing for Semidefinite Programming

Decomposed Structured Subsets for Semidefinite Optimization

Decomposition Methods for Large-Scale Semidefinite Programs with Chordal Aggregate Sparsity and Partial Orthogonality

Well-conditioned Primal-Dual Interior-point Method for Accurate Low-rank Semidefinite Programming

Barrier and penalty methods for low-rank semidefinite programming with application to truss topology design

Post-Processing with Projection and Rescaling Algorithms for Semidefinite Programming

Chordal Decomposition in Operator-Splitting Methods for Sparse Semidefinite Programs

A sequential semidefinite programming method and an application in passive reduced-order modeling

Exploring chordal sparsity in semidefinite programming with sparse plus low-rank data matrices

Proximal-stabilized semidefinite programming

An Overview and Comparison of Spectral Bundle Methods for Primal and Dual Semidefinite Programs

IPRSDP: a primal-dual interior-point relaxation algorithm for semidefinite programming

Fast ADMM for Semidefinite Programs with Chordal Sparsity

Fast, Scalable, Warm-Start Semidefinite Programming with Spectral Bundling and Sketching

A squared smoothing Newton method for semidefinite programming

Structured Semidefinite Programming for Recovering Structured Preconditioners

A Fast Semidefinite Approach to Solving Binary Quadratic Problems

Degeneracy in Maximal Clique Decomposition for Semidefinite Programs

Chordal Decomposition in Rank Minimized Semidefinite Programs with Applications to Subspace Clustering

A predictor-corrector algorithm for semidefinite programming that uses the factor width cone

Row by row methods for semidefinite programming