Abstract:We give a damped proximal augmented Lagrangian method (DPALM) for solving problems with a weakly-convex objective and convex linear/nonlinear constraints. Instead of taking a full stepsize, DPALM adopts a damped dual stepsize to ensure the boundedness of dual iterates. We show that DPALM can produce a (near) $\vareps$-KKT point within $O(\vareps^{-2})$ outer iterations if each DPALM subproblem is solved to a proper accuracy. In addition, we establish overall iteration complexity of DPALM when the objective is either a regularized smooth function or in a regularized compositional form. For the former case, DPALM achieves the complexity of $\widetilde{\mathcal{O}}\left(\varepsilon^{-2.5} \right)$ to produce an $\varepsilon$-KKT point by applying an accelerated proximal gradient (APG) method to each DPALM subproblem. For the latter case, the complexity of DPALM is $\widetilde{\mathcal{O}}\left(\varepsilon^{-3} \right)$ to produce a near $\varepsilon$-KKT point by using an APG to solve a Moreau-envelope smoothed version of each subproblem. Our outer iteration complexity and the overall complexity either generalize existing best ones from unconstrained or linear-constrained problems to convex-constrained ones, or improve over the best-known results on solving the same-structured problems. Furthermore, numerical experiments on linearly/quadratically constrained non-convex quadratic programs and linear-constrained robust nonlinear least squares are conducted to demonstrate the empirical efficiency of the proposed DPALM over several state-of-the art methods.

A New Logarithmic-Quadratic Proximal Method for Nonlinear Complementarity Problems.

An approximate proximal point algorithm for nonlinear complementarity problems

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

A Constrained Optimization Approach for Lcp

NE/SQP: A robust algorithm for the nonlinear complementarity problem

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Superlinear/quadratic one-step smoothing Newton method for P 0 -NCP without strict complementarity

Smoothed Proximal Lagrangian Method for Nonlinear Constrained Programs

A Smoothing Levenberg-Marquardt Type Method for Lcp

Global Linear and Quadratic One-step Smoothing Newton Method for P 0 -LCP

Nonnegative Iterative Reweighted Method for Sparse Linear Complementarity Problem

Globally Solving Quadratic Programs with Convex Objective and Complementarity Constraints Via Completely Positive Programming

Superlinear／Quadratic One-step Smoothing Newton Methodf or P0-NCP

Global and local convergence of a nonmonotone SQP method for constrained nonlinear optimization

A new superlinearly convergent algorithm of combining QP subproblem with system of linear equations for nonlinear optimization

Improved Smoothing Newton Methods for P0 Nonlinear Complementarity Problems

Damped Proximal Augmented Lagrangian Method for weakly-Convex Problems with Convex Constraints

An Accelerated Proximal Gradient-Based Algorithm for Quadratic Programming

Superlinear/Quadratic One–step Smoothing Newton Method for P 0–NCP

A QCQP-based splitting SQP algorithm for two-block nonconvex constrained optimization problems with application

A variant to Sequential Quadratic Programming for nonlinear Model Predictive Control