Abstract:We consider a class of constrained optimization problems where the objective function is a sum of a smooth function and a nonconvex non-Lipschitz function. Many problems in sparse portfolio selection, edge preserving image restoration, and signal processing can be modelled in this form. First, we propose the concept of the Karush-Kuhn-Tucker (KKT) stationary condition for the non-Lipschitz problem and show that it is necessary for optimality under a constraint qualification called the relaxed constant positive linear dependence (RCPLD) condition, which is weaker than the Mangasarian-Fromovitz constraint qualification and holds automatically if all the constraint functions are affine. Then we propose an augmented Lagrangian (AL) method in which the augmented Lagrangian subproblems are solved by a nonmonotone proximal gradient method. Under the assumption that a feasible point is known, we show that any accumulation point of the sequence generated by our method must be a feasible point. Moreover, if RCPLD holds at such an accumulation point, then it is a KKT point of the original problem. Finally, we conduct numerical experiments to compare the performance of our AL method and the interior point (IP) method for solving two sparse portfolio selection models. The numerical results demonstrate that our method is not only comparable to the IP method in terms of solution quality, but also substantially faster than the IP method.

Lagrange optimality system for a class of nonsmooth convex optimization

A Smoothing Augmented Lagrangian Method for Nonconvex, Nonsmooth Constrained Programs and Its Applications to Bilevel Problems

Gauss-Newton Methods for A Class of Nonsmooth Optimization Problems

A Semismooth Newton Based Augmented Lagrangian Method for Nonsmooth Optimization on Matrix Manifolds

Smoothing Augmented Lagrangian Method for Nonsmooth Constrained Optimization Problems.

Implicit augmented Lagrangian and generalized optimization

Nonconvex and Nonsmooth Optimization with Generalized Orthogonality Constraints: an Approximate Augmented Lagrangian Method

Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization

An Augmented Lagrangian Method for Non-Lipschitz Nonconvex Programming

First-order Optimality Conditions for Two Classes of Generalized Nonsmooth Semi-Infinite Optimization

On Saddle Points of Augmented Lagrangians for Constrained Nonconvex Optimization

Nonconvex Lagrangian-Based Optimization: Monitoring Schemes and Global Convergence

A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization

A class of nonlinear Lagrangians for nonconvex second order cone programming

The inexact power augmented Lagrangian method for constrained nonconvex optimization

A look at the convergence of the augmented Lagrange method for nondifferentiable convex programming from the view of a gradient method with constant stepsize

Affordable mixed-integer Lagrangian methods: optimality conditions and convergence analysis

Augmented Lagrangian optimization under fixed-point arithmetic

Optimization Condition and Algorithm of Optimization with Convertible Nonconvex Function

Log-Sigmoid Nonlinear Lagrange Method for Nonlinear Optimization Problems over Second-Order Cones