Abstract:The alternating direction method of multipliers (ADMM) is a benchmark for solving a two-block linearly constrained convex minimization model whose objective function is the sum of two functions without coupled variables. Meanwhile, it is known that the convergence is not guaranteed if the ADMM is directly extended to a multiple-block convex minimization model whose objective function has more than two functions. Recently, some authors have actively studied the strong convexity condition on the objective function to sufficiently ensure the convergence of the direct extension of ADMM or the resulting convergence when the original scheme is appropriately twisted. We focus on the three-block case of such a model whose objective function is the sum of three functions, and discuss the convergence of the direct extension of ADMM. We show that when one function in the objective is strongly convex, the penalty parameter and the operators in the linear equality constraint are appropriately restricted, it is sufficient to guarantee the convergence of the direct extension of ADMM. We further estimate the worst-case convergence rate measured by the iteration complexity in both the ergodic and nonergodic senses, and derive the globally linear convergence in asymptotical sense under some additional conditions.

A Note on the Alternating Direction Method of Multipliers

A Linearized Alternating Direction Method of Multipliers with Substitution Procedure.

A note on the convergence of alternating proximal gradient method

Convergence Analysis of Alternating Direction Method of Multipliers for a Class of Separable Convex Programming

A Homotopy Alternating Direction Method of Multipliers for Linearly Constrained Separable Convex Optimization

On the Convergence Analysis of the Alternating Direction Method of Multipliers with Three Blocks

On the Convergence of a Generalized Alternating Direction Method of Multipliers with Semi-Proximal Terms

A Symmetric Alternating Direction Method of Multipliers for Separable Nonconvex Minimization Problems

Local Linear Convergence of the Alternating Direction Method of Multipliers for Nonconvex Separable Optimization Problems

Alternating Direction Method of Multipliers for a Class of Nonconvex Bilinear Optimization: Convergence Analysis and Applications.

Inexact Alternating-Direction-Based Contraction Methods for Separable Linearly Constrained Convex Optimization

A Bregman-style Partially Symmetric Alternating Direction Method of Multipliers for Nonconvex Multi-block Optimization

Convergence Analysis on a Modified Generalized Alternating Direction Method of Multipliers

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming.

A Generalized Alternating Direction Method of Multipliers with Semi-Proximal Terms for Convex Composite Conic Programming

A Hybrid Bregman Alternating Direction Method of Multipliers for the Linearly Constrained Difference-of-convex Problems

On the dual step length of the alternating direction method of multipliers

On the Convergence of the Direct Extension of ADMM for Three-Block Separable Convex Minimization Models with One Strongly Convex Function.

Local Linear Convergence of the Alternating Direction Method of Multipliers for Quadratic Programs

Alternating Direction Method of Multipliers with Variable Metric Indefinite Proximal Terms for Convex Optimization