Abstract:There are many important practical optimization problems whose feasible regions are not known to be nonempty or not, and optimizers of the objective function with the least constraint violation prefer to be found. A natural way for dealing with these problems is to extend the nonlinear optimization problem as the one optimizing the objective function over the set of points with the least constraint violation. This leads to the study of the shifted problem. This paper focuses on the constrained convex optimization problem. The sufficient condition for the closedness of the set of feasible shifts is presented and the continuity properties of the optimal value function and the solution mapping for the shifted problem are studied. Properties of the conjugate dual of the shifted problem are discussed through the relations between the dual function and the optimal value function. The solvability of the dual of the optimization problem with the least constraint violation is investigated. It is shown that, if the least violated shift is in the domain of the subdifferential of the optimal value function, then this dual problem has an unbounded solution set. Under this condition, the optimality conditions for the problem with the least constraint violation are established in term of the augmented Lagrangian. It is shown that the augmented Lagrangian method has the properties that the sequence of shifts converges to the least violated shift and the sequence of multipliers is unbounded. Moreover, it is proved that the augmented Lagrangian method is able to find an approximate solution to the problem with the least constraint violation and it has linear rate of convergence under an error bound condition. The augmented Lagrangian method is applied to an illustrative convex second-order cone constrained optimization problem with least constraint violation and numerical results verify our theoretical results.

On Saddle Points of Augmented Lagrangians for Constrained Nonconvex Optimization

Existence of a Saddle Point in Nonconvex Constrained Optimization

A Smoothing Augmented Lagrangian Method for Nonconvex, Nonsmooth Constrained Programs and Its Applications to Bilevel Problems

An Augmented Lagrangian Approach with A Variable Transformation in Nonlinear Programming

On the Convergence of Augmented Lagrangian Methods for Constrained Global Optimization

Smoothing Augmented Lagrangian Method for Nonsmooth Constrained Optimization Problems.

Convergence of the Augmented Lagrangian Method for Nonlinear Optimization Problems over Second-Order Cones

An Augmented Lagrangian Method for Non-Lipschitz Nonconvex Programming

Convexification and existence of a saddle point in a pth-power reformulation for nonconvex constrained optimization

A New Insight on Augmented Lagrangian Method with Applications in Machine Learning

Convergence analysis of the augmented Lagrangian method for nonlinear second-order cone optimization problems

The inexact power augmented Lagrangian method for constrained nonconvex optimization

Constraint Qualifications for Optimality Conditions and Total Lagrange Dualities in Convex Infinite Programming

Exact Augmented Lagrangian Duality for Mixed Integer Convex Optimization

Convergence Results of an Augmented Lagrangian Method Using the Exponential Penalty Function

Inexact Augmented Lagrangian Methods for Conic Programs: Quadratic Growth and Linear Convergence

A Class of Nonlinear Lagrangians: Theory and Algorithm.

The Augmented Lagrangian Method Can Approximately Solve Convex Optimization with Least Constraint Violation

Lagrange optimality system for a class of nonsmooth convex optimization

Local properties and augmented Lagrangians in fully nonconvex composite optimization

Global Convergence Analysis of the Power Proximal Point and Augmented Lagrangian Method