Abstract:Due to its wide applications and simple implementations, the Alternating Direction Method of Multipliers (ADMM) has been extensively investigated by researchers from different areas. In this paper, we focus on a linearized symmetric ADMM (LSADMM) for solving the multiblock separable convex minimization model. This LSADMM partitions the data into two group variables and updates the Lagrange multiplier twice in different forms and with suitable stepsizes, where two grouped variables are updated in a Gauss-Seidel scheme while variables within each group are updated in a Jacobi scheme. For the second group variables, however, linearized and relaxation techniques are used to deal with the quadratic term of subproblems and to accelerate the algorithm, respectively. Since the proximal operator is designed uncertainly (positive-definite or positive-indefinite), the region of the proximal parameter, involved in the second group subproblems, is partitioned into the union of three different sets. We show the global convergence and the sublinear ergodic convergence rate of LSADMM for the two cases, and give a counter-example to illustrate that the convergence of LSADMM for the remaining case can not be guaranteed. Theoretically, we obtain the optimal lower bound of the proximal parameter. Furthermore, a linearized full Jacobian splitting version of augmented Lagrangian method can be deduced from the proposed method. Besides, numerical experiments on the Latent Variable Gaussian Graphical Model Selection (LVGGMS) problems are presented to demonstrate the efficiency of the proposed algorithm and the significant advantage of the optimal lower bound of the proximal parameter.

Fast Proximal Linearized Alternating Direction Method of Multiplier with Parallel Splitting

A Generalization of Linearized Alternating Direction Method of Multipliers for Solving Two-Block Separable Convex Programming

Proximal Alternating Direction Method of Multipliers with Convex Combination Proximal Centers

A Golden Ratio Proximal Alternating Direction Method of Multipliers for Separable Convex Optimization

An Inertial Proximal Partially Symmetric ADMM-based Algorithm for Linearly Constrained Multi-Block Nonconvex Optimization Problems with Applications.

Linearized Symmetric Multi-Block ADMM with Indefinite Proximal Regularization and Optimal Proximal Parameter

Accelerated linearized alternating direction method of multipliers with Nesterov extrapolation

Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming.

A Bregman-style Partially Symmetric Alternating Direction Method of Multipliers for Nonconvex Multi-block Optimization

Parallel Direction Method of Multipliers

A New Fast Adaptive Linearized Alternating Direction Multiplier Method for Convex Optimization

A Generalized Alternating Direction Method of Multipliers with Semi-Proximal Terms for Convex Composite Conic Programming

A Hybrid Type ADMM for Multi-Block Separable Convex Programming

A Stochastic Alternating Direction Method of Multipliers for Non-smooth and Non-convex Optimization

Optimal linearized symmetric ADMM for multi-block separable convex programming

An Inertial Proximal Alternating Direction Method of Multipliers for Nonconvex Optimization.

An Alternating Direction Method of Multipliers with the BFGS Update for Structured Convex Quadratic Optimization

A Fast Symmetric Alternating Direction Method of Multipliers

A LINEARLY CONVERGENT MAJORIZED ADMM WITH INDEFINITE PROXIMAL TERMS FOR CONVEX COMPOSITE PROGRAMMING AND ITS APPLICATIONS

A new accelerated positive-indefinite proximal admm for constrained separable convex optimization problems

A Distributed Proximal Alternating Direction Multiplier Method for Multiblock Nonsmooth Composite Optimization