Abstract:SIAM Journal on Optimization, Volume 34, Issue 2, Page 1679-1707, June 2024. Classical primal-dual algorithms attempt to solve [math] by alternately minimizing over the primal variable [math] through primal descent and maximizing the dual variable [math] through dual ascent. However, when [math] is highly nonconvex with complex constraints in [math], the minimization over [math] may not achieve global optimality and, hence, the dual ascent step loses its valid intuition. This observation motivates us to propose a new class of primal-dual algorithms for nonconvex constrained optimization with the key feature to reverse dual ascent to a conceptually new dual descent, in a sense, elevating the dual variable to the same status as the primal variable. Surprisingly, this new dual scheme achieves some best iteration complexities for solving nonconvex optimization problems. In particular, when the dual descent step is scaled by a fractional constant, we name it scaled dual descent (SDD), otherwise, unscaled dual descent (UDD). For nonconvex multiblock optimization with nonlinear equality constraints, we propose SDD-alternating direction method of multipliers (SDD-ADMM) and show that it finds an [math]-stationary solution in [math] iterations. The complexity is further improved to [math] and [math] under proper conditions. We also propose UDD-augmented Lagrangian method (UDD-ALM), combining UDD with ALM, for weakly convex minimization over affine constraints. We show that UDD-ALM finds an [math]-stationary solution in [math] iterations. These complexity bounds for both algorithms either achieve or improve the best-known results in the ADMM and ALM literature. Moreover, SDD-ADMM addresses a long-standing limitation of existing ADMM frameworks.

Success Guarantee of Dual Search in Integer Programming: p-th Power Lagrangian Method

A Nonlinear Lagrangian Dual For Integer Programming

Towards Strong Duality in Integer Programming

Asymptotic Strong Determination in Integer Programming: Quasi Dual Method

New Dual Formulations In Constrained Integer Programming

Convergent Lagrangian and Contour Cut Method for Nonlinear Integer Programming with a Quadratic Objective Function

A Parallel Method With Hybrid Algorithms For Mixed Integer Nonlinear Programming

Eliminating duality gap in integer programming via objective cuts

Generalized Nonlinear Lagrangian Formulation for Bounded Integer Programming

Logarithmic-Exponential Dual Formulation For Integer Programming

Computing Exact Solution to Nonlinear Integer Programming: Convergent Lagrangian and Objective Level Cut Method.

A New Penalty Dual-Primal Augmented Lagrangian Method and Its Extensions

A New Algorithm for Finding Global Solution of Indefinite Quadratic Programming Problems

An efficient algorithm for nonlinear integer programming problems arising in series–parallel reliability systems

A novel dual-decomposition method for non-convex mixed integer quadratically constrained quadratic problems

Alternating Direction Augmented Lagrangian Methods for Semidefinite Programming

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

Dual Descent Augmented Lagrangian Method and Alternating Direction Method of Multipliers

IPRSDP: a primal-dual interior-point relaxation algorithm for semidefinite programming

A projected-search interior-point method for nonlinearly constrained optimization

Infeasibility Detection with Primal-Dual Hybrid Gradient for Large-Scale Linear Programming