Abstract:This paper presents and analyzes the first matrix optimization model which allows general coordinate and spectral constraints. The breadth of problems our model covers is exemplified by a lengthy list of examples from the literature, including semidefinite programming, matrix completion, and quadratically constrained quadratic programs (QCQPs), and we demonstrate our model enables completely novel formulations of numerous problems. Our solution methodology leverages matrix factorization and constrained manifold optimization to develop an equivalent reformulation of our general matrix optimization model for which we design a feasible, first-order algorithm. We prove our algorithm converges to $(\epsilon,\epsilon)$-approximate first-order KKT points of our reformulation in $\mathcal{O}(1/\epsilon^2)$ iterations. The method we developed applies to a special class of constrained manifold optimization problems and is one of the first which generates a sequence of feasible points which converges to a KKT point. We validate our model and method through numerical experimentation. Our first experiment presents a generalized version of semidefinite programming which allows novel eigenvalue constraints, and our second numerical experiment compares our method to the classical semidefinite relaxation approach for solving QCQPs. For the QCQP numerical experiments, we demonstrate our method is able to dominate the classical state-of-the-art approach, solving more than ten times as many problems compared to the standard solution procedure.

On Some Aspects of Perturbation Analysis for Matrix Cone Optimization Induced by Spectral Norm

Optimality Conditions for Problems over Symmetric Cones and a Simple Augmented Lagrangian Method

Perturbation analysis of a class of composite optimization problems

On singularly perturbed systems that are monotone with respect to a matrix cone of rank $k$

The robust isolated calmness of spectral norm regularized convex matrix optimization problems

Optimality and Complexity for Constrained Optimization Problems with Nonconvex Regularization.

On semidefinite programming relaxations for a class of robust SOS-convex polynomial optimization problems

Spectrally Constrained Optimization

Strong calmness of perturbed KKT system for a class of conic programming with degenerate solutions

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

On Degenerate Doubly Nonnegative Projection Problems

An Efficient Matrix Splitting Method for the Second-Order Cone Complementarity Problem

General Constrained Matrix Optimization

Finite Convergence of Moment-SOS Relaxations with Nonreal Radical Ideals

Integer Points in Arbitrary Convex Cones: The Case of the PSD and SOC Cones

The GUS-property of second-order cone linear complementarity problems

Stability and Performance Analysis on Self-dual Cones

A Krylov Subspace Method for Large-Scale Second-Order Cone Linear Complementarity Problem

A second-order sequential optimality condition for nonlinear second-order cone programming problems

Finite convergence of Moment-SOS relaxations with non-real radical ideals

Tightness of the matrix Moment-SOS hierarchy