Abstract:We design inexact proximal augmented Lagrangian based decomposition methods for convex composite programming problems with dual block-angular structures. Our methods are particularly well suited for convex quadratic programming problems arising from stochastic programming models. The algorithmic framework is based on the application of the abstract inexact proximal ADMM framework developed in [Chen, Sun, Toh, Math. Prog. 161:237--270] to the dual of the target problem, as well as the application of the recently developed symmetric Gauss-Seidel decomposition theorem for solving a proximal multi-block convex composite quadratic programming problem. The key issues in our algorithmic design are firstly in designing appropriate proximal terms to decompose the computation of the dual variable blocks of the target problem to make the subproblems in each iteration easier to solve, and secondly to develop novel numerical schemes to solve the decomposed subproblems efficiently. Our inexact augmented Lagrangian based decomposition methods have guaranteed convergence. We present an application of the proposed algorithms to the doubly nonnegative relaxations of uncapacitated facility location problems, as well as to two-stage stochastic optimization problems. We conduct numerous numerical experiments to evaluate the performance of our method against state-of-the-art solvers such as Gurobi and MOSEK. Moreover, our proposed algorithms also compare favourably to the well-known progressive hedging algorithm of Rockafellar and Wets.

Convergence Properties of Modified and Partially-Augmented Lagrangian Methods for Mathematical Programs with Complementarity Constraints

On the Convergence of Augmented Lagrangian Methods for Constrained Global Optimization

Inexact Augmented Lagrangian Methods for Conic Programs: Quadratic Growth and Linear Convergence

On Convergence of the Gauss-Newton Method for Convex Composite Optimization

convergence rates of (dual-primal) balanced augmented Lagrangian methods for linearly constrained convex programming

Extended Newton Methods for Multiobjective Optimization: Majorizing Function Technique and Convergence Analysis

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Local convergence of augmented Lagrangian methods for composite optimization

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Convergence Analysis of Modulus-Based Matrix Splitting Iterative Methods for Implicit Complementarity Problems

Local properties and augmented Lagrangians in fully nonconvex composite optimization

Globally Solving Quadratic Programs with Convex Objective and Complementarity Constraints Via Completely Positive Programming

Global Convergence Analysis of the Power Proximal Point and Augmented Lagrangian Method

Constraint Qualifications for Optimality Conditions and Total Lagrange Dualities in Convex Infinite Programming

An Augmented Lagrangian Method for State Constrained Linear Parabolic Optimal Control Problems

Solving mathematical programs with complementarity constraints arising in nonsmooth optimal control

A New Insight on Augmented Lagrangian Method with Applications in Machine Learning

A Primal Majorized Semismooth Newton-CG Augmented Lagrangian Method for Large-Scale Linearly Constrained Convex Programming

Convergence Analysis of Generalized ADMM with Majorization for Linearly Constrained Composite Convex Optimization

On proximal augmented Lagrangian based decomposition methods for dual block-angular convex composite programming problems