Abstract:We consider a class of constrained optimization problems where the objective function is a sum of a smooth function and a nonconvex non-Lipschitz function. Many problems in sparse portfolio selection, edge preserving image restoration, and signal processing can be modelled in this form. First, we propose the concept of the Karush-Kuhn-Tucker (KKT) stationary condition for the non-Lipschitz problem and show that it is necessary for optimality under a constraint qualification called the relaxed constant positive linear dependence (RCPLD) condition, which is weaker than the Mangasarian-Fromovitz constraint qualification and holds automatically if all the constraint functions are affine. Then we propose an augmented Lagrangian (AL) method in which the augmented Lagrangian subproblems are solved by a nonmonotone proximal gradient method. Under the assumption that a feasible point is known, we show that any accumulation point of the sequence generated by our method must be a feasible point. Moreover, if RCPLD holds at such an accumulation point, then it is a KKT point of the original problem. Finally, we conduct numerical experiments to compare the performance of our AL method and the interior point (IP) method for solving two sparse portfolio selection models. The numerical results demonstrate that our method is not only comparable to the IP method in terms of solution quality, but also substantially faster than the IP method.

Second-Order Conditions for the Existence of Augmented Lagrange Multipliers for Sparse Optimization

An Augmented Lagrangian Method for Non-Lipschitz Nonconvex Programming

Local convergence of augmented Lagrangian methods for composite optimization

A New Insight on Augmented Lagrangian Method with Applications in Machine Learning

Optimality Conditions for Problems over Symmetric Cones and a Simple Augmented Lagrangian Method

On Saddle Points of Augmented Lagrangians for Constrained Nonconvex Optimization

Sequential Lagrange Multiplier Condition Forϵ-Optimal Solution in Convex Programming

Exact Augmented Lagrangian Duality for Mixed Integer Convex Optimization

A first-order augmented Lagrangian method for constrained minimax optimization

Inexact Augmented Lagrangian Methods for Conic Programs: Quadratic Growth and Linear Convergence

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

Implicit augmented Lagrangian and generalized optimization

A New Penalty Dual-Primal Augmented Lagrangian Method and Its Extensions

A Correlatively Sparse Lagrange Multiplier Expression Relaxation for Polynomial Optimization

The inexact power augmented Lagrangian method for constrained nonconvex optimization

Second-order conditions for spatio-temporally sparse optimal control via second subderivatives

An Inexact Augmented Lagrangian Framework for Nonconvex Optimization with Nonlinear Constraints

Sparse Inverse Problems Over Measures: Equivalence of the Conditional Gradient and Exchange Methods

First- and second-order optimality conditions of nonsmooth sparsity multiobjective optimization via variational analysis

A Dual Semismooth Newton Based Augmented Lagrangian Method for Large-Scale Linearly Constrained Sparse Group Square-Root Lasso Problems