Abstract:In this paper, we propose an inexact multi-block ADMM-type first-order method for solving a class of high-dimensional convex composite conic optimization problems to moderate accuracy. The design of this method combines an inexact 2-block majorized semi-proximal ADMM and the recent advances in the inexact symmetric Gauss-Seidel (sGS) technique for solving a multi-block convex composite quadratic programming whose objective contains a nonsmooth term involving only the first block-variable. One distinctive feature of our proposed method (the sGS-imsPADMM) is that it only needs one cycle of an inexact sGS method, instead of an unknown number of cycles, to solve each of the subproblems <a class="link-external link-http" href="http://involved.With" rel="external noopener nofollow">this http URL</a> some simple and implementable error tolerance criteria, the cost for solving the subproblems can be greatly reduced, and many steps in the forward sweep of each sGS cycle can often be skipped, which further contributes to the efficiency of the proposed method. Global convergence as well as the iteration complexity in the non-ergodic sense is <a class="link-external link-http" href="http://established.Preliminary" rel="external noopener nofollow">this http URL</a> numerical experiments on some high-dimensional linear and convex quadratic SDP problems with a large number of linear equality and inequality constraints are also provided. The results show that for the vast majority of the tested problems, the sGS-imsPADMM is 2 to 3 times faster than the directly extended multi-block ADMM with the aggressive step-length of 1.618, which is currently the benchmark among first-order methods for solving multi-block linear and quadratic SDP problems though its convergence is not guaranteed.

A LINEARLY CONVERGENT MAJORIZED ADMM WITH INDEFINITE PROXIMAL TERMS FOR CONVEX COMPOSITE PROGRAMMING AND ITS APPLICATIONS

On the Q-linear Convergence of a Majorized Proximal ADMM for Convex Composite Programming and Its Applications to Regularized Logistic Regression

Convergence Analysis of Generalized ADMM with Majorization for Linearly Constrained Composite Convex Optimization

GENERALIZED ADMM WITH OPTIMAL INDEFINITE PROXIMAL TERM FOR LINEARLY CONSTRAINED CONVEX OPTIMIZATION

Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming.

An Efficient Inexact Symmetric Gauss-Seidel Based Majorized ADMM for High-Dimensional Convex Composite Conic Programming

Linearized Symmetric Multi-Block ADMM with Indefinite Proximal Regularization and Optimal Proximal Parameter

An Inertial Proximal Partially Symmetric ADMM-based Algorithm for Linearly Constrained Multi-Block Nonconvex Optimization Problems with Applications.

Linear Convergence of the Alternating Direction Method of Multipliers for a Class of Convex Optimization Problems

The symmetric ADMM with indefinite proximal regularization and its application

A Unified Algorithmic Framework of Symmetric Gauss-Seidel Decomposition Based Proximal ADMMs for Convex Composite Programming

A Generalized Alternating Direction Method of Multipliers with Semi-Proximal Terms for Convex Composite Conic Programming

Majorized Ipadmm for Nonseparable Convex Minimization Models with Quadratic Coupling Terms

Alternating Direction Method of Multipliers with Variable Metric Indefinite Proximal Terms for Convex Optimization

Linearized ADMM for Nonconvex Nonsmooth Optimization with Convergence Analysis

A new accelerated positive-indefinite proximal admm for constrained separable convex optimization problems

A Bregman-Style Improved ADMM and its Linearized Version in the Nonconvex Setting: Convergence and Rate Analyses

Optimal linearized symmetric ADMM for multi-block separable convex programming

Convergence Analysis on a Modified Generalized Alternating Direction Method of Multipliers

Proximal Alternating Direction Method of Multipliers with Convex Combination Proximal Centers

Linearized Block-Wise Alternating Direction Method of Multipliers for Multiple-Block Convex Programming