Abstract:Nonconvex constrained optimization problems can be used to model a number of machine learning problems, such as multi-class Neyman-Pearson classification and constrained Markov decision processes. However, such kinds of problems are challenging because both the objective and constraints are possibly nonconvex, so it is difficult to balance the reduction of the loss value and reduction of constraint violation. Although there are a few methods that solve this class of problems, all of them are double-loop or triple-loop algorithms, and they require oracles to solve some subproblems up to certain accuracy by tuning multiple hyperparameters at each iteration. In this paper, we propose a novel gradient descent and perturbed ascent (GDPA) algorithm to solve a class of smooth nonconvex inequality constrained problems. The GDPA is a primal-dual algorithm, which only exploits the first-order information of both the objective and constraint functions to update the primal and dual variables in an alternating way. The key feature of the proposed algorithm is that it is a single-loop algorithm, where only two step-sizes need to be tuned. We show that under a mild regularity condition GDPA is able to find Karush-Kuhn-Tucker (KKT) points of nonconvex functional constrained problems with convergence rate guarantees. To the best of our knowledge, it is the first single-loop algorithm that can solve the general nonconvex smooth problems with nonconvex inequality constraints. Numerical results also showcase the superiority of GDPA compared with the best-known algorithms (in terms of both stationarity measure and feasibility of the obtained solutions).

The Convergence of a Dual Algorithm for Nonlinear Programming

A New Algorithm For Unconstrained Optimization Problem With The Form Of Sum Of Squares Minimization

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

A primal-dual interior-point relaxation method with global and rapidly local convergence for nonlinear programs

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

On Convergence of the Gauss-Newton Method for Convex Composite Optimization

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Convergence depth control based polynary hybrid nonlinear programming algorithm

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

Linear Convergence of the Proximal Gradient Method for Composite Optimization Under the Polyak-Łojasiewicz Inequality and Its Variant

Convergence of successive linear programming algorithms for noisy functions

A new superlinearly convergent algorithm of combining QP subproblem with system of linear equations for nonlinear optimization

On the Convergence of L-shaped Algorithms for Two-Stage Stochastic Programming

A Unified Primal-Dual Algorithm Framework for Inequality Constrained Problems

NPASA: An algorithm for nonlinear programming -- Motivation and Global Convergence

A Constrained Optimization Approach for Lcp

A Canonical Dual Approach for Solving Linearly Constrained Quadratic Programs

Global Convergence of the Polak-Ribière and Hestenes-Stiefel Conjugate Gradient Methods for the Unconstrained Nonlinear Optimization

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization