Abstract:We revisit a formulation technique for inequality constrained optimization problems that has been known for decades: the substitution of squared variables for nonnegative variables. Using this technique, inequality constraints are converted to equality constraints via the introduction of a squared-slack variable. Such formulations have the superficial advantage that inequality constraints can be dispensed with altogether. But there are clear disadvantages, not least being that first-order optimal points for the squared-variable reformulation may not correspond to first-order optimal points for the original problem, because the Lagrange multipliers may have the wrong sign. Extending previous results, this paper shows that points satisfying approximate second-order optimality conditions for the squared-variable reformulation also, under certain conditions, satisfy approximate second-order optimality conditions for the original formulation, and vice versa. Such results allow us to adapt complexity analysis of methods for equality constrained optimization to account for inequality constraints. On the algorithmic side, we examine squared-variable formulations for several interesting problem classes, including bound-constrained quadratic programming and linear programming. We show that algorithms built on these formulations are surprisingly competitive with standard methods. For linear programming, we examine the relationship between the squared-variable approach and primal-dual interior-point methods.

A version of the simplex method for solving linear systems of inequalities and linear programming problems

Simplex Method for Solving Linear Programs

Heuristics for Finding Sparse Solutions of Linear Inequalities

A Smoothing-Type Algorithm for Solving System of Inequalities

Unconstrained Optimization Method for Solving Linear Inequalities

A structured modified Newton approach for solving systems of nonlinear equations arising in interior-point methods for quadratic programming

Dual Dictionaries in Linear Programming

On Squared-Variable Formulations

A Class of Simple Dual Nonlinear Methods for Solving Linear Inequalities

Dynamic system methods for solving mixed linear matrix inequalities and linear vector inequalities and equalities

Linear Programming in Isabelle/HOL

A LP relaxation based matheuristic for multi-objective integer programming

On the Number of Degenerate Simplex Pivots

A Simpler Approach to Linear Programming

A Unified Tool for Solving Uni-Parametric Linear Programs, Convex Quadratic Programs, and Linear Complementarity Problems

THE PHASE 1 SIMPLEX ALGORITHM ON THE OBJECTIVE HYPERPLANE

A simplex-type algorithm for continuous linear programs with constant coefficients

A Monotonic Build-Up Simplex Algorithm for Linear Programming

A short note on solving box inequality and linear equality constrained optimization problem

Large-Scale Optimization with Linear Equality Constraints Using Reduced Compact Representation

Numerical experience with iterative methods for equality constrained nonlinear programming problems