Abstract:There are many important practical optimization problems whose feasible regions are not known to be nonempty or not, and optimizers of the objective function with the least constraint violation prefer to be found. A natural way for dealing with these problems is to extend the nonlinear optimization problem as the one optimizing the objective function over the set of points with the least constraint violation. This leads to the study of the shifted problem. This paper focuses on the constrained convex optimization problem. The sufficient condition for the closedness of the set of feasible shifts is presented and the continuity properties of the optimal value function and the solution mapping for the shifted problem are studied. Properties of the conjugate dual of the shifted problem are discussed through the relations between the dual function and the optimal value function. The solvability of the dual of the optimization problem with the least constraint violation is investigated. It is shown that, if the least violated shift is in the domain of the subdifferential of the optimal value function, then this dual problem has an unbounded solution set. Under this condition, the optimality conditions for the problem with the least constraint violation are established in term of the augmented Lagrangian. It is shown that the augmented Lagrangian method has the properties that the sequence of shifts converges to the least violated shift and the sequence of multipliers is unbounded. Moreover, it is proved that the augmented Lagrangian method is able to find an approximate solution to the problem with the least constraint violation and it has linear rate of convergence under an error bound condition. The augmented Lagrangian method is applied to an illustrative convex second-order cone constrained optimization problem with least constraint violation and numerical results verify our theoretical results.

Convergence of the Augmented Lagrangian Method for Nonlinear Optimization Problems over Second-Order Cones

Convergence analysis of the augmented Lagrangian method for nonlinear second-order cone optimization problems

The Rate of Convergence of the Augmented Lagrangian Method for Nonlinear Semidefinite Programming.

Log-Sigmoid Nonlinear Lagrange Method for Nonlinear Optimization Problems over Second-Order Cones

The Rate of Convergence of the Augmented Lagrangian Method for a Nonlinear Semidefinite Nuclear Norm Composite Optimization Problem

Augmented Lagrangian method for nonlinear circular conic programs: a local convergence analysis

A class of nonlinear Lagrangians for nonconvex second order cone programming

The convergence of conjugate gradient method with nonmonotone line search

Convergence Analysis of the Augmented Lagrangian Method for ℓ _p -Norm Cone Optimization Problems with P ≥ 2

The Augmented Lagrangian Method for a Type of Inverse Quadratic Programming Problems over Second-Order Cones

Local convergence of augmented Lagrangian methods for composite optimization

Convergence Analysis of a Nonlinear Lagrange Algorithm for Nonconvex Semidefinite Programming

The Rate of Convergence of Augmented Lagrangian Method for Minimax Optimization Problems with Equality Constraints

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

On the approximate augmented Lagrangian for nonlinear symmetric cone programming

Convergence Analysis of a Nonlinear Lagrangian Algorithm for Nonlinear Programming with Inequality Constraints

A look at the convergence of the augmented Lagrange method for nondifferentiable convex programming from the view of a gradient method with constant stepsize

On the Convergence of Augmented Lagrangian Methods for Constrained Global Optimization

On Saddle Points of Augmented Lagrangians for Constrained Nonconvex Optimization

The Augmented Lagrangian Method Can Approximately Solve Convex Optimization with Least Constraint Violation

Global Convergence Analysis of the Power Proximal Point and Augmented Lagrangian Method