Global Complexity Bound of a Proximal ADMM for Linearly Constrained Nonseparable Nonconvex Composite Programming

Weiwei Kong,Renato D. C. Monteiro
DOI: https://doi.org/10.1137/22m1503129
IF: 2.763
2024-01-12
SIAM Journal on Optimization
Abstract:SIAM Journal on Optimization, Volume 34, Issue 1, Page 201-224, March 2024. This paper proposes and analyzes a dampened proximal alternating direction method of multipliers (DP.ADMM) for solving linearly constrained nonconvex optimization problems where the smooth part of the objective function is nonseparable. Each iteration of DP.ADMM consists of (i) a sequence of partial proximal augmented Lagrangian (AL) updates, (ii) an under-relaxed Lagrange multiplier update, and (iii) a novel test to check whether the penalty parameter of the AL function should be updated. Under a basic Slater point condition and some requirements on the dampening factor and under-relaxation parameter, it is shown that DP.ADMM obtains an approximate first-order stationary point of the constrained problem in [math] iterations for a given numerical tolerance [math]. One of the main novelties of the paper is that convergence of the method is obtained without requiring any rank assumptions on the constraint matrices.
mathematics, applied
What problem does this paper attempt to address?