Abstract:We consider a separable convex minimization model whose variables are coupled by linear constraints and they are subject to the positive orthant constraints, and its objective function is in form of m functions without coupled variables. It is well recognized that when the augmented Lagrangian method (ALM) is applied to solve some concrete applications, the resulting subproblem at each iteration should be decomposed to generate solvable subproblems. When the Gauss-Seidel decomposition is implemented, this idea has inspired the alternating direction method of multiplier (for m=2) and its variants (for m≥3). When the Jacobian decomposition is considered, it has been shown that the ALM with Jacobian decomposition in its subproblem is not necessarily convergent even when m=2 and it was suggested to regularize the decomposed subproblems with quadratic proximal terms to ensure the convergence. In this paper, we focus on the multiple-block case with m≥3. We consider implementing the full Jacobian decomposition to ALM’s subproblems and using the logarithmic-quadratic proximal (LQP) terms to regularize the decomposed subproblems. The resulting subproblems are all unconstrained minimization problems because the positive orthant constraints are all inactive; and they are fully eligible for parallel computation. Accordingly, the ALM with full Jacobian decomposition and LQP regularization is proposed. We also consider its inexact version which allows the subproblems to be solved inexactly. For both the exact and inexact versions, we comprehensively discuss their convergence, including their global convergence, worst-case convergence rates measured by the iteration-complexity in both the ergodic and nonergodic senses, and linear convergence rates under additional assumptions. Some preliminary numerical results are reported to demonstrate the efficiency of the ALM with full Jacobian decomposition and LQP regularization.

A Strictly Contractive Peaceman-Rachford Splitting Method with Logarithmic-Quadratic Proximal Regularization for Convex Programming

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

A Modified Strictly Contractive Peaceman-Rachford Splitting Method for Multi-Block Separable Convex Programming

Convergence Study on Strictly Contractive Peaceman–Rachford Splitting Method for Nonseparable Convex Minimization Models with Quadratic Coupling Terms

A Proximal Peaceman-Rachford Splitting Method for Solving the Multi-Block Separable Convex Minimization Problems.

Inertial Generalized Proximal Peaceman–Rachford Splitting Method for Separable Convex Programming

Generalized Peaceman–Rachford Splitting Method with Substitution for Convex Programming

An Indefinite-Proximal-based Strictly Contractive Peaceman-Rachford Splitting Method

Inertial Proximal Strictly Contractive Peaceman-Rachford Splitting Method with an Indefinite Term for Convex Optimization

Convergence of the Peaceman-Rachford Splitting Method for a Class of Nonconvex Programs

Multi-step Inertial Strictly Contractive PRSM Algorithms for Convex Programming Problems with Applications.

The Augmented Lagrangian Method with Full Jacobian Decomposition and Logarithmic-Quadratic Proximal Regularization for Multiple-Block Separable Convex Programming

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

An efficient algorithm for globally minimizing sum of quadratic ratios problem with nonconvex quadratic constraints

A Proximal Parallel Splitting Method for Minimizing Sum of Convex Functions with Linear Constraints.

An ADM-based Splitting Method for Separable Convex Programming

Convergence analysis of the Peaceman-Rachford splitting method for nonsmooth convex optimization

A Customized Douglas–Rachford Splitting Algorithm for Separable Convex Minimization with Linear Constraints

A second order inexact log-exponential regularization method for mathematical programs with complementarity constraints

A relaxed customized proximal point algorithm for separable convex programming

An LQP-Based Two-Step Method for Structured Variational Inequalities