Abstract:We consider a class of constrained optimization problems where the objective function is a sum of a smooth function and a nonconvex non-Lipschitz function. Many problems in sparse portfolio selection, edge preserving image restoration, and signal processing can be modelled in this form. First, we propose the concept of the Karush-Kuhn-Tucker (KKT) stationary condition for the non-Lipschitz problem and show that it is necessary for optimality under a constraint qualification called the relaxed constant positive linear dependence (RCPLD) condition, which is weaker than the Mangasarian-Fromovitz constraint qualification and holds automatically if all the constraint functions are affine. Then we propose an augmented Lagrangian (AL) method in which the augmented Lagrangian subproblems are solved by a nonmonotone proximal gradient method. Under the assumption that a feasible point is known, we show that any accumulation point of the sequence generated by our method must be a feasible point. Moreover, if RCPLD holds at such an accumulation point, then it is a KKT point of the original problem. Finally, we conduct numerical experiments to compare the performance of our AL method and the interior point (IP) method for solving two sparse portfolio selection models. The numerical results demonstrate that our method is not only comparable to the IP method in terms of solution quality, but also substantially faster than the IP method.

Convergence of a Recurrent Neural Network for Nonconvex Optimization Based on an Augmented Lagrangian Function

A Recurrent Neural Network for Solving Nonconvex Optimization Problems

Neural Network Solution for General Nonlinear Optimization Problems

A discrete-time neural network for optimization problems with hybrid constraints.

An Augmented Lagrangian Method for Training Recurrent Neural Networks

A Two-Layer Recurrent Neural Network for Nonsmooth Convex Optimization Problems

A fast algorithm for solving large scale nonlinear optimization problems using RNN

A neural network with finite-time convergence for a class of variational inequalities

Subgradient-based Neural Networks for Nonsmooth Nonconvex Optimization Problems

A one-layer recurrent neural network for nonsmooth pseudoconvex optimization with quasiconvex inequality and affine equality constraints

Distributed nonconvex optimization subject to globally coupled constraints via collaborative neurodynamic optimization

Convergence of the Augmented Lagrangian Method for Nonlinear Optimization Problems over Second-Order Cones

A Recurrent Neural Network with Finite-Time Convergence for Convex Quadratic Bilevel Programming Problems

Neural Network for Nonsmooth Pseudoconvex Optimization with General Convex Constraints

Consensus-based Distributed Augmented Lagrangian Method for Nonconvex Optimization with Coupled Constraints

An Augmented Lagrangian Method for Non-Lipschitz Nonconvex Programming

A Novel Neural Network for Nonlinear Convex Programming

Recurrent Neural Network for Complex-Variable Pseudoconvex Optimization with Equality Constraints

A new recurrent neural network for solving convex quadratic programming problems with an application to the κ-winners-take-all problem

Finite-Time Convergent Recurrent Neural Network with a Hard-Limiting Activation Function for Constrained Optimization with Piecewise-Linear Objective Functions

A recurrent neural network for non-smooth convex programming subject to linear equality and bound constraints