Proximal augmented lagrangian method for convex

JING YUAN

2021-01-01

Abstract:Abstract. The augmented Lagrangian method (ALM) provides a benchmark for solving the 5 canonical convex programming problem with linear equality constraints; it also inspires a number of 6 variants for various applications in different areas. Among them, the proximal version of ALM, by 7 adding an additional positive-definite quadratic proximal term to the estimation of primal variable, 8 is often implemented to tackle many problems and its convergence has been well studied in the liter9 ature. The most recent study reveals an interesting fact that the positive definite regularization term 10 is not necessarily required to ensure the convergence of the proximal ALM, which hence results in 11 an indefinite linearized ALM with a larger step-size for speeding up convergence. The literature on 12 the inequality-constrained ALM, however, is relatively few. In this paper, exploiting the variational 13 inequality structure of the indefinite linearized ALM, we present a novel indefinite linearized ALM 14 framework to study the linear inequality constrained convex optimization problem, which gives rise 15 to a new ALM-based method. The proposed method enjoys great advantages in two folds: first, it 16 reduces the computation difficulty of the core subproblem in the original inequality-constrained ALM 17 to the one in the linearized equality-constrained ALM; second, the relaxation of the proximal regu18 larization term allows a bigger step size to potentially reduce required convergence iterations. The 19 extensive numerical experiments on some convex-relaxed image segmentation models demonstrate 20 the efficiency of the novel method. 21