Quadratic convex reformulation for quadratic programming with linear on-off constraints.

Baiyi Wu,Duan Li,Rujun Jiang

DOI: https://doi.org/10.1016/j.ejor.2018.09.028

IF: 6.4

2019-01-01

European Journal of Operational Research

Abstract:•Advance the state-of-the-art for quadratic programming with on–off constraints.•Generalize the quadratic convex reformulation approach.•Derive an effective reformulation that can be solved by standard solvers.

What problem does this paper attempt to address?

QUADRATIC CONVEX REFORMULATIONS FOR SEMICONTINUOUS QUADRATIC PROGRAMMING

Baiyi Wu,Xiaoling Sun,Duan Li,Xiaojin Zheng

DOI: https://doi.org/10.1137/15m1012232

IF: 2.763

2017-01-01

SIAM Journal on Optimization

Abstract:We consider in this paper a class of semicontinuous quadratic programming problems, which arises in many real-world applications such as production planning, portfolio selection, and subset selection in regression. We build upon the idea of the quadratic convex reformulation approach, i.e., adding to the original objective function an additional convex term that is zero at all points of the feasible region. Exploiting the structure of semicontinuous variables, we derive the most general set of quadratic functions that can be added. We also incorporate the state-of-the-art perspective reformulation into our new framework. Within this framework, the set of optimal reformulations with the tightest continuous relaxation can be found by solving a semidefinite programming problem. We also explore the relationship among different reformulations within our framework and simplify the search for optimal ones in certain cases with the help of second-order cone programming. Among the proposed set of optimal reformulations, we can choose one with or without the perspective component. If the perspective component is present, the new reformulation can be solved by the perspective cut algorithm in the literature. If the perspective component is not present, the new reformulation is a standard mixed-integer quadratic programming (MIQP) problem and can be plugged into and solved by any MIQP solvers. Our preliminary numerical tests in both portfolio selection and subset selection problems have demonstrated the effectiveness of our new reformulations, and the comparison results indicate that the performance of the new reformulation without the perspective component, when solved in general MIQP solvers, is competitive to the perspective cut approach.
Quadratic Convex Reformulations for Integer and Mixed-Integer Quadratic Programs

Baiyi Wu,Rujun Jiang

DOI: https://doi.org/10.1007/978-3-319-53518-0_4

2017-01-01

Abstract:We review recent advances in the quadratic convex reformulation (QCR) approach that is employed to derive efficient equivalent reformulations for mixed-integer quadratically constrained quadratic programming (MIQCQP) problems. Although MIQCQP problems can be directly plugged into and solved by standard MIQP solvers that are based on branch-and-bound algorithms, it is not efficient because the continuous relaxation of the standard MIQCQP reformulation is very loose. The QCR approach is a systematic way to derive tight equivalent reformulations. We will explore the QCR technique on subclasses of MIQCQP problems with simpler structures first and then generalize it step by step such that it can be applied to general MIQCQP problems. We also cover the recent extension of QCR on semi-continuous quadratic programming problems.
Solving Convex Quadratic Programming by Potential-Reduction Interior-Point Algorithm

Liang Xi-ming,Ma Long-hua,Qian Ji-xin

DOI: https://doi.org/10.1007/bf02841179

2001-01-01

Journal of Zhejiang University SCIENCE A

Abstract:The solution of quadratic programming problems is an important issue in the field of mathematical programming and industrial applications. In this paper, we solve convex quadratic programming by a potential-reduction interior—point algorithm. It is proved that the potential—reduction interior-point algorithm is globally convergent. Some numerical experiments were made.
A Mixed-Binary Convex Quadratic Reformulation for Box-Constrained Nonconvex Quadratic Integer Program

Yong Xia,Ying-Wei Han

DOI: https://doi.org/10.48550/arXiv.1401.5881

2014-01-23

Abstract:In this paper, we propose a mixed-binary convex quadratic programming reformulation for the box-constrained nonconvex quadratic integer program and then implement IBM ILOG CPLEX 12.6 to solve the new model. Computational results demonstrate that our approach clearly outperform the very recent state-of-the-art solvers.

Optimization and Control
Global solutions of nonconvex standard quadratic programs via mixed integer linear programming reformulations

Jacek Gondzio,E. Alper Yıldırım

DOI: https://doi.org/10.1007/s10898-021-01017-y

2021-04-20

Journal of Global Optimization

Abstract:Abstract A standard quadratic program is an optimization problem that consists of minimizing a (nonconvex) quadratic form over the unit simplex. We focus on reformulating a standard quadratic program as a mixed integer linear programming problem. We propose two alternative formulations. Our first formulation is based on casting a standard quadratic program as a linear program with complementarity constraints. We then employ binary variables to linearize the complementarity constraints. For the second formulation, we first derive an overestimating function of the objective function and establish its tightness at any global minimizer. We then linearize the overestimating function using binary variables and obtain our second formulation. For both formulations, we propose a set of valid inequalities. Our extensive computational results illustrate that the proposed mixed integer linear programming reformulations significantly outperform other global solution approaches. On larger instances, we usually observe improvements of several orders of magnitude.

mathematics, applied,operations research & management science
Second Order Cone Constrained Convex Relaxations for Nonconvex Quadratically Constrained Quadratic Programming

Rujun Jiang,Duan Li

DOI: https://doi.org/10.48550/arXiv.1608.02096

2017-09-16

Abstract:In this paper, we present new convex relaxations for nonconvex quadratically constrained quadratic programming (QCQP) problems. While recent research has focused on strengthening convex relaxations using reformulation-linearization technique (RLT), the state-of-the-art methods lose their effectiveness when dealing with (multiple) nonconvex quadratic constraints in QCQP. In this research, we decompose and relax each nonconvex constraint to two second order cone (SOC) constraints and then linearize the products of the SOC constraints and linear constraints to construct some effective new valid constraints. Moreover, we extend the reach of the RLT-like techniques for almost all different types of constraint-pairs (including valid inequalities by linearizing the product of a pair of SOC constraints, and the the Hadamard product or the Kronecker product of two respective valid linear matrix inequalities), examine dominance relationships among different valid inequalities, and explore almost all possibilities of gaining benefits from generating valid constraints. Especially, we successfully demonstrate that applying RLT-like techniques to additional redundant linear constraints could reduce the relaxation gap. We demonstrate the efficiency of our results with numerical experiments.

Optimization and Control
Tight MIQP Reformulations for Semi-Continuous Quadratic Programming: Lift-and-Convexification Approach

Baiyi Wu,Xiaoling Sun,Duan Li,Xiaojin Zheng

DOI: https://doi.org/10.1137/15m1012232

2015-01-01

Abstract:We consider in this paper a class of semi-continuous quadratic programming problems which arises in many real-world applications such as production planning, portfolio selection and subset selection in regression. We propose a lift-and-convexification approach to derive an equivalent reformulation of the original problem. This lift-and-convexification approach lifts the quadratic term involving $x$ only in the original objective function $f(x,y)$ to a quadratic function of both $x$ and $y$ and convexifies this equivalent objective function. While the continuous relaxation of our new reformulation attains the same tight bound as achieved by the continuous relaxation of the well known perspective reformulation, the new reformulation also retains the linearly constrained quadratic programming structure of the original mix-integer problem. This prominent feature improves the performance of branch-and-bound algorithms by providing the same tightness at the root node as the state-of-the-art perspective reformulation and offering much faster processing time at children nodes. We further combine the lift-and-convexification approach and the quadratic convex reformulation approach in the literature to form an even tighter reformulation. Promising results from our computational tests in both portfolio selection and subset selection problems numerically verify the benefits from these theoretical features of our new reformulations.
Tight MIQP Reformulations for Semi-Continuous Quadratic Programming: Lift-and-Convexification Approach

Baiyi Wu,Xiaoling Sun,Duan Li,Xiaojin Zheng

DOI: https://doi.org/10.1137/15m1012232

2015-01-01

Abstract: We consider in this paper a class of semi-continuous quadratic programming problems which arises in many real-world applications such as production planning, portfolio selection and subset selection in regression. We propose a lift-and-convexification approach to derive an equivalent reformulation of the original problem. This lift-and-convexification approach lifts the quadratic term involving $x$ only in the original objective function $f(x,y)$ to a quadratic function of both $x$ and $y$ and convexifies this equivalent objective function. While the continuous relaxation of our new reformulation attains the same tight bound as achieved by the continuous relaxation of the well known perspective reformulation, the new reformulation also retains the linearly constrained quadratic programming structure of the original mix-integer problem. This prominent feature improves the performance of branch-and-bound algorithms by providing the same tightness at the root node as the state-of-the-art perspective reformulation and offering much faster processing time at children nodes. We further combine the lift-and-convexification approach and the quadratic convex reformulation approach in the literature to form an even tighter reformulation. Promising results from our computational tests in both portfolio selection and subset selection problems numerically verify the benefits from these theoretical features of our new reformulations.
Lagrangian Decomposition and Mixed-Integer Quadratic Programming Reformulations for Probabilistically Constrained Quadratic Programs

Xiaojin Zheng,Xiaoling Sun,Duan Li,Xueting Cui

DOI: https://doi.org/10.1016/j.ejor.2012.03.006

IF: 6.4

2012-01-01

European Journal of Operational Research

Abstract:Probabilistically constrained quadratic programming (PCQP) problems arise naturally from many real-world applications and have posed a great challenge in front of the optimization society for years due to the nonconvex and discrete nature of its feasible set. We consider in this paper a special case of PCQP where the random vector has a finite discrete distribution. We first derive second-order cone programming (SOCP) relaxation and semidefinite programming (SDP) relaxation for the problem via a new Lagrangian decomposition scheme. We then give a mixed integer quadratic programming (MIQP) reformulation of the PCQP and show that the continuous relaxation of the MIQP is exactly the SOCP relaxation. This new MIQP reformulation is more efficient than the standard MIQP reformulation in the sense that its continuous relaxation is tighter than or at least as tight as that of the standard MIQP. We report preliminary computational results to demonstrate the tightness of the new convex relaxations and the effectiveness of the new MIQP reformulation. (C) 2012 Elsevier B.V. All rights reserved.
Quadratic Optimization over One First-Order Cone

Xiaoling Guo,Zhibin Deng,Shu-Cherng Fang,Wenxun Xing

DOI: https://doi.org/10.3934/jimo.2014.10.945

2014-01-01

Journal of Industrial and Management Optimization

Abstract:This paper studies the first-order cone constrained homogeneous quadratic programming problem. For efficient computation, the problem is reformulated as a linear conic programming problem. A union of second-order cones are designed to cover the first-order cone such that a sequence of linear conic programming problems can be constructed to approximate the conic reformulation. Since the cone of nonnegative quadratic forms over a union of second-order cones has a linear matrix inequalities representation, each linear conic programming problem in the sequence is polynomial-time solvable by applying semidefinite programming techniques. The convergence of the sequence is guaranteed when the union of second-order cones gets close enough to the first-order cone. In order to further improve the efficiency, an adaptive scheme is adopted. Numerical experiments are provided to illustrate the efficiency of the proposed approach.
Quadratic Optimization over a Second-Order Cone with Linear Equality Constraints

Xiao-ling Guo,Zhi-bin Deng,Shu-Cherng Fang,Zhen-bo Wang,Wen-xun Xing

DOI: https://doi.org/10.1007/s40305-013-0035-6

2013-01-01

Journal of the Operations Research Society of China

Abstract:This paper studies the nonhomogeneous quadratic programming problem over a second-order cone with linear equality constraints. When the feasible region is bounded, we show that an optimal solution of the problem can be found in polynomial time. When the feasible region is unbounded, a semidefinite programming (SDP) reformulation is constructed to find the optimal objective value of the original problem in polynomial time. In addition, we provide two sufficient conditions, under which, if the optimal objective value is finite, we show the optimal solution of SDP reformulation can be decomposed into the original space to generate an optimal solution of the original problem in polynomial time. Otherwise, a recession direction can be identified in polynomial time. Numerical examples are included to illustrate the effectiveness of the proposed approach.
Second Order Optimality Conditions and Reformulations for Nonconvex Quadratically Constrained Quadratic Programming Problems

Ziye Shi,Qingwei Jin

DOI: https://doi.org/10.3934/jimo.2014.10.871

2014-01-01

Journal of Industrial and Management Optimization

Abstract:In this paper, we present an optimality condition which could determine whether a given KKT solution is globally optimal. This condition is equivalent to determining if the Hessian of the corresponding Largrangian is copositive over a set. To find the corresponding Lagrangian multiplier, two linear conic programming problems are constructed and then relaxed for computational purpose. Under the new condition, we proposed a local search based scheme to find a global optimal solution and showed its effectiveness by three examples.
An exact solution method for unconstrained quadratic 0–1 programming: a geometric approach

D. Li,X. L. Sun,C. L. Liu

DOI: https://doi.org/10.1007/s10898-011-9713-2

2011-01-01

Journal of Global Optimization

Abstract:We explore in this paper certain rich geometric properties hidden behind quadratic 0–1 programming. Especially, we derive new lower bounding methods and variable fixation techniques for quadratic 0–1 optimization problems by investigating geometric features of the ellipse contour of a (perturbed) convex quadratic function. These findings further lead to some new optimality conditions for quadratic 0–1 programming. Integrating these novel solution schemes into a proposed solution algorithm of a branch-and-bound type, we obtain promising preliminary computational results.
Convex Relaxation and Lagrangian Decomposition for Indefinite Integer Quadratic Programming

X. L. Sun,J. L. Li,H. Z. Luo

DOI: https://doi.org/10.1080/02331930801987607

IF: 2.2

2010-01-01

Optimization

Abstract:We study lower bounding methods for indefinite integer quadratic programming problems. We first construct convex relaxations by D.C. (difference of convex functions) decomposition and linear underestimation. Lagrangian bounds are then derived by applying dual decomposition schemes to separable relaxations. Relationships between the convex relaxation and Lagrangian dual are established. Finally, we prove that the lower bound provided by the convex relaxation coincides with the Lagrangian bound of the orthogonally transformed problem. 1This article is dedicated to the memory of Professor Alex Rubinov.
An Improved Sequential Quadratic Programming Algorithm for Solving General Nonlinear Programming Problems

Chuan-Hao Guo,Yan-Qin Bai,Jin-Bao Jian

DOI: https://doi.org/10.48550/arXiv.1206.3359

2012-06-15

Optimization and Control

Abstract:In this paper, a class of general nonlinear programming problems with inequality and equality constraints is discussed. Firstly, the original problem is transformed into an associated simpler equivalent problem with only inequality constraints. Then, inspired by the ideals of sequential quadratic programming (SQP) method and the method of system of linear equations (SLE), a new type of SQP algorithm for solving the original problem is proposed. At each iteration, the search direction is generated by the combination of two directions, which are obtained by solving an always feasible quadratic programming (QP) subproblem and a SLE, respectively. Moreover, in order to overcome the Maratos effect, the higher-order correction direction is obtained by solving another SLE. The two SLEs have the same coefficient matrices, and we only need to solve the one of them after a finite number of iterations. By a new line search technique, the proposed algorithm possesses global and superlinear convergence under some suitable assumptions without the strict complementarity. Finally, some comparative numerical results are reported to show that the proposed algorithm is effective and promising.
Compact mixed-integer programming formulations in quadratic optimization

Benjamin Beach,Robert Hildebrand,Joey Huchette

DOI: https://doi.org/10.1007/s10898-022-01184-6

2022-06-14

Journal of Global Optimization

Abstract:We present a technique for producing valid dual bounds for nonconvex quadratic optimization problems. The approach leverages an elegant piecewise linear approximation for univariate quadratic functions due to Yarotsky (Neural Netw 94:103–114, 2017), formulating this (simple) approximation using mixed-integer programming (MIP). Notably, the number of constraints, binary variables, and auxiliary continuous variables used in this formulation grows logarithmically in the approximation error. Combining this with a diagonal perturbation technique to convert a nonseparable quadratic function into a separable one, we present a mixed-integer convex quadratic relaxation for nonconvex quadratic optimization problems. We study the strength (or sharpness ) of our formulation and the tightness of its approximation. Further, we show that our formulation represents feasible points via a Gray code. We close with computational results on problems with quadratic objectives and/or constraints, showing that our proposed method (i) across the board outperforms existing MIP relaxations from the literature, and (ii) on hard instances produces better bounds than exact solvers within a fixed time budget.

mathematics, applied,operations research & management science
Quadratic Optimization over A Polyhedral Cone

Ye Tian,Qingwei Jin,Zhibin Deng

DOI: https://doi.org/10.3934/jimo.2016.12.269

2015-01-01

Journal of Industrial and Management Optimization

Abstract:In this paper, we study the polyhedral cone constrained homogeneous quadratic programming problem and provide an equivalent linear conic reformulation. Based on a union of second-order cones which covers the polyhedral cone, a sequence of computable linear conic programming problems are constructed to approximate the linear conic reformulation. The convergence of the sequential solutions is guaranteed as the number of second-order cones increases such that the union of the second-order cones gets close to the polyhedral cone. In order to relieve the computational burden and improve the efficiency, an adaptive scheme and valid inequalities derived by the reformulation-linearization technique are added to the proposed algorithm. Finally, the numerical results demonstrate the effectiveness of the algorithm.
Conic Approximation to Quadratic Optimization with Linear Complementarity Constraints.

Jing Zhou,Shu-Cherng Fang,Wenxun Xing

DOI: https://doi.org/10.1007/s10589-016-9855-8

2016-01-01

Computational Optimization and Applications

Abstract:This paper proposes a conic approximation algorithm for solving quadratic optimization problems with linear complementarity constraints.We provide a conic reformulation and its dual for the original problem such that these three problems share the same optimal objective value. Moreover, we show that the conic reformulation problem is attainable when the original problem has a nonempty and bounded feasible domain. Since the conic reformulation is in general a hard problem, some conic relaxations are further considered. We offer a condition under which both the semidefinite relaxation and its dual problem become strictly feasible for finding a lower bound in polynomial time. For more general cases, by adaptively refining the outer approximation of the feasible set, we propose a conic approximation algorithm to identify an optimal solution or an $\epsilon $-optimal solution of the original problem. A convergence proof is given under simple assumptions. Some computational results are included to illustrate the effectiveness of the proposed algorithm.
On Squared-Variable Formulations

Lijun Ding,Stephen J. Wright

2023-10-03

Abstract:We revisit a formulation technique for inequality constrained optimization problems that has been known for decades: the substitution of squared variables for nonnegative variables. Using this technique, inequality constraints are converted to equality constraints via the introduction of a squared-slack variable. Such formulations have the superficial advantage that inequality constraints can be dispensed with altogether. But there are clear disadvantages, not least being that first-order optimal points for the squared-variable reformulation may not correspond to first-order optimal points for the original problem, because the Lagrange multipliers may have the wrong sign. Extending previous results, this paper shows that points satisfying approximate second-order optimality conditions for the squared-variable reformulation also, under certain conditions, satisfy approximate second-order optimality conditions for the original formulation, and vice versa. Such results allow us to adapt complexity analysis of methods for equality constrained optimization to account for inequality constraints. On the algorithmic side, we examine squared-variable formulations for several interesting problem classes, including bound-constrained quadratic programming and linear programming. We show that algorithms built on these formulations are surprisingly competitive with standard methods. For linear programming, we examine the relationship between the squared-variable approach and primal-dual interior-point methods.

Optimization and Control
An Improved Convex 0-1 Quadratic Program Reformulation for Chance-Constrained Quadratic Knapsack Problems.

Shuhui Ji,Xiaojin Zheng,Xiaoling Sun

DOI: https://doi.org/10.1142/s0217595913400095

2013-01-01

Asia-Pacific Journal of Operational Research

Abstract:We consider a chance-constrained quadratic knapsack problem (CQKP) where each item has a random size that is finitely distributed. We present a new convex 0-1 quadratic program reformulation for CQKP. This new reformulation improves the existing reformulation for general 0-1 quadratic program based on diagonal perturbation in the sense that the continuous relaxation of the new reformulation is tighter than or at least as tight as that of the existing reformulation. The improved reformulation is derived from a general matrix decomposition of the objective function and piecewise linearization of 0-1 variables. We show that the optimal parameters in the improved reformulation can be obtained by solving an SDP problem. Extension to k-item probabilistic quadratic knapsack problems is also discussed. Preliminary comparison results are reported to demonstrate the effectiveness of the improved reformulation.

Quadratic convex reformulation for quadratic programming with linear on-off constraints.

QUADRATIC CONVEX REFORMULATIONS FOR SEMICONTINUOUS QUADRATIC PROGRAMMING

Quadratic Convex Reformulations for Integer and Mixed-Integer Quadratic Programs

Solving Convex Quadratic Programming by Potential-Reduction Interior-Point Algorithm

A Mixed-Binary Convex Quadratic Reformulation for Box-Constrained Nonconvex Quadratic Integer Program

Global solutions of nonconvex standard quadratic programs via mixed integer linear programming reformulations

Second Order Cone Constrained Convex Relaxations for Nonconvex Quadratically Constrained Quadratic Programming

Tight MIQP Reformulations for Semi-Continuous Quadratic Programming: Lift-and-Convexification Approach

Tight MIQP Reformulations for Semi-Continuous Quadratic Programming: Lift-and-Convexification Approach

Lagrangian Decomposition and Mixed-Integer Quadratic Programming Reformulations for Probabilistically Constrained Quadratic Programs

Quadratic Optimization over One First-Order Cone

Quadratic Optimization over a Second-Order Cone with Linear Equality Constraints

Second Order Optimality Conditions and Reformulations for Nonconvex Quadratically Constrained Quadratic Programming Problems

An exact solution method for unconstrained quadratic 0–1 programming: a geometric approach

Convex Relaxation and Lagrangian Decomposition for Indefinite Integer Quadratic Programming

An Improved Sequential Quadratic Programming Algorithm for Solving General Nonlinear Programming Problems

Compact mixed-integer programming formulations in quadratic optimization

Quadratic Optimization over A Polyhedral Cone

Conic Approximation to Quadratic Optimization with Linear Complementarity Constraints.

On Squared-Variable Formulations

An Improved Convex 0-1 Quadratic Program Reformulation for Chance-Constrained Quadratic Knapsack Problems.