Abstract:We consider a class of constrained optimization problems where the objective function is a sum of a smooth function and a nonconvex non-Lipschitz function. Many problems in sparse portfolio selection, edge preserving image restoration, and signal processing can be modelled in this form. First, we propose the concept of the Karush-Kuhn-Tucker (KKT) stationary condition for the non-Lipschitz problem and show that it is necessary for optimality under a constraint qualification called the relaxed constant positive linear dependence (RCPLD) condition, which is weaker than the Mangasarian-Fromovitz constraint qualification and holds automatically if all the constraint functions are affine. Then we propose an augmented Lagrangian (AL) method in which the augmented Lagrangian subproblems are solved by a nonmonotone proximal gradient method. Under the assumption that a feasible point is known, we show that any accumulation point of the sequence generated by our method must be a feasible point. Moreover, if RCPLD holds at such an accumulation point, then it is a KKT point of the original problem. Finally, we conduct numerical experiments to compare the performance of our AL method and the interior point (IP) method for solving two sparse portfolio selection models. The numerical results demonstrate that our method is not only comparable to the IP method in terms of solution quality, but also substantially faster than the IP method.

Local properties and augmented Lagrangians in fully nonconvex composite optimization

Local convergence of augmented Lagrangian methods for composite optimization

Implicit augmented Lagrangian and generalized optimization

Affordable mixed-integer Lagrangian methods: optimality conditions and convergence analysis

An Augmented Lagrangian Approach to Composite Problems with a Random Linear Operator

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

On Convergence of the Gauss-Newton Method for Convex Composite Optimization

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

The inexact power augmented Lagrangian method for constrained nonconvex optimization

An Augmented Lagrangian Method for Non-Lipschitz Nonconvex Programming

A Unified Algorithmic Framework for Distributed Composite Optimization.

On Saddle Points of Augmented Lagrangians for Constrained Nonconvex Optimization

Global Convergence Analysis of the Power Proximal Point and Augmented Lagrangian Method

Linearization Algorithms for Fully Composite Optimization

Stable and Total Fenchel Duality for Convex Optimization Problems in Locally Convex Spaces

Convergence Properties of Modified and Partially-Augmented Lagrangian Methods for Mathematical Programs with Complementarity Constraints

An Inexact Augmented Lagrangian Framework for Nonconvex Optimization with Nonlinear Constraints

On the Convergence of Augmented Lagrangian Methods for Constrained Global Optimization

Gauss-Newton Methods for A Class of Nonsmooth Optimization Problems

On the local convergence of the semismooth Newton method for composite optimization