Abstract:We revisit a formulation technique for inequality constrained optimization problems that has been known for decades: the substitution of squared variables for nonnegative variables. Using this technique, inequality constraints are converted to equality constraints via the introduction of a squared-slack variable. Such formulations have the superficial advantage that inequality constraints can be dispensed with altogether. But there are clear disadvantages, not least being that first-order optimal points for the squared-variable reformulation may not correspond to first-order optimal points for the original problem, because the Lagrange multipliers may have the wrong sign. Extending previous results, this paper shows that points satisfying approximate second-order optimality conditions for the squared-variable reformulation also, under certain conditions, satisfy approximate second-order optimality conditions for the original formulation, and vice versa. Such results allow us to adapt complexity analysis of methods for equality constrained optimization to account for inequality constraints. On the algorithmic side, we examine squared-variable formulations for several interesting problem classes, including bound-constrained quadratic programming and linear programming. We show that algorithms built on these formulations are surprisingly competitive with standard methods. For linear programming, we examine the relationship between the squared-variable approach and primal-dual interior-point methods.

A short note on solving box inequality and linear equality constrained optimization problem

A Novel Penalty Approach for Nonlinear Dynamic Optimization Problems with Inequality Path Constraints

Ill-posed linear inverse problems with box constraints: A new convex optimization approach

Unconstrained Optimization Method for Solving Linear Inequalities

On Squared-Variable Formulations

A subspace SQP method for equality constrained optimization

An Algorithm for a Class of Functional Inequality Constrained Optimization Problems

Heuristics for Finding Sparse Solutions of Linear Inequalities

A Feasible and Superlinear Algorithm for Inequality Constrained Minimization Problems

A Smoothing-Type Algorithm for Solving System of Inequalities

Solving the L1 regularized least square problem via a box-constrained smooth minimization

Calibrating Least Squares Semidefinite Programming with Equality and Inequality Constraints

Approximation of optimization problems with constraints through kernel Sum-Of-Squares

A QP-FREE AND SUPERLINEARLY CONVERGENT ALGORITHM FOR INEQUALITY CONSTRAINEDOPTIMIZATIONS

Optimal solutions to a class of nonconvex minimization problems with linear inequality constraints

Optimal box contraction for solving linear systems via simulated and quantum annealing

A Feasible Method for Optimization with Orthogonality Constraints

A version of the simplex method for solving linear systems of inequalities and linear programming problems

Computing moment inequality models using constrained optimization