Parametric Lagrangian Dual for the Binary Quadratic Programming Problem

Yong Xia,Wenxun Xing

DOI: https://doi.org/10.1007/s10898-014-0164-4

2014-01-01

Journal of Global Optimization

Abstract:Based on a difference between convex decomposition of the Lagrangian function, we propose and study a family of parametric Lagrangian dual for the binary quadratic program. Then we show they improve several lower bounds in recent literature.

What problem does this paper attempt to address?

Improved Estimation of Duality Gap in Binary Quadratic Programming Using a Weighted Distance Measure

Yong Xia,Ruey-Lin Sheu,Xiaoling Sun,Duan Li

DOI: https://doi.org/10.1016/j.ejor.2011.10.034

IF: 6.4

2011-01-01

European Journal of Operational Research

Abstract:We present in this paper an improved estimation of duality gap between binary quadratic program and its Lagrangian dual. More specifically, we obtain this improved estimation using a weighted distance measure between the binary set and certain affine subspace. We show that the optimal weights can be computed by solving a semidefinite programming problem. We further establish a necessary and sufficient condition under which the weighted distance measure gives a strictly tighter estimation of the duality gap than the existing estimations. (C) 2011 Elsevier B.V. All rights reserved.
Duality Gap Estimation Of Linear Equality Constrained Binary Quadratic Programming

Xiaojin Zheng,Xiaoling Sun,Duan Li,Yong Xia

DOI: https://doi.org/10.1287/moor.1100.0472

IF: 2.215

2010-01-01

Mathematics of Operations Research

Abstract:We investigate in this paper the Lagrangian duality properties of linear equality constrained binary quadratic programming. We derive an underestimation of the duality gap between the primal problem and its Lagrangian dual or SDP relaxation, using the distance from the set of binary integer points to certain affine subspace, while the computation of this distance can be achieved by the cell enumeration of hyperplane arrangement. Alternative Lagrangian dual schemes via the exact penalty and the squared norm constraint reformulations are also discussed.
On Duality Gap in Binary Quadratic Programming

X. L. Sun,C. L. Liu,D. Li,J. J. Gao

DOI: https://doi.org/10.1007/s10898-011-9683-4

2011-01-01

Journal of Global Optimization

Abstract:We investigate in this paper the duality gap between the binary quadratic optimization problem and its semidefinite programming relaxation. We show that the duality gap can be underestimated by \({\xi_{r+1}\delta^2}\), where δ is the distance between {−1, 1} n and certain affine subspace, and ξ r+1 is the smallest positive eigenvalue of a perturbed matrix. We also establish the connection between the computation of δ and the cell enumeration of hyperplane arrangement in discrete geometry.
Convergent Lagrangian and Contour Cut Method for Nonlinear Integer Programming with a Quadratic Objective Function

D. Li,X. L. Sun,F. L. Wang

DOI: https://doi.org/10.1137/040606193

IF: 2.763

2006-01-01

SIAM Journal on Optimization

Abstract:In this paper we present an efficient exact solution method for solving nonlinear separable integer programming problems with a quadratic objective function. The proposed method combines the Lagrangian dual method with a duality reduction scheme using contour cut. At each iteration of the algorithm, lower and upper bounds of the problem are determined by the Lagrangian dual search. To eliminate the duality gap, a novel cut-and-partition scheme is derived by exploring the special structure of the quadratic contour. The method finds an exact solution of the problem in a finite number of iterations. Computational results are reported for problems with up to 2000 integer variables. Comparison results with other methods are also presented.
An Improved Lower Bound and Approximation Algorithm for Binary Constrained Quadratic Programming Problem

Cheng Lu,Zhenbo Wang,Wenxun Xing

DOI: https://doi.org/10.1007/s10898-009-9504-1

2009-01-01

Journal of Global Optimization

Abstract:This paper presents an improved lower bound and an approximation algorithm based on spectral decomposition for the binary constrained quadratic programming problem. To decompose spectrally the quadratic matrix in the objective function, we construct a low rank problem that provides a lower bound. Then an approximation algorithm for the binary quadratic programming problem together with a worst case performance analysis for the algorithm is provided.
Polynomially Solvable Cases Of Binary Quadratic Programs

Duan Li,Xiaoling Sun,Shenshen Gu,Jianjun Gao,Chunli Liu

DOI: https://doi.org/10.1007/978-0-387-89496-6_11

2010-01-01

Abstract:We summarize in this chapter polynomially solvable subclasses of binary quadratic programming problems studied in the literature and report some new polynomially solvable subclasses revealed in our recent research. It is well known that the binary quadratic programming program is NP-hard in general. Identifying polynomially solvable subclasses of binary quadratic programming problems not only offers theoretical insight into the complicated nature of the problem but also provides platforms to design relaxation schemes for exact solution methods. We discuss and analyze in this chapter six polynomially solvable subclasses of binary quadratic programs, including problems with special structures in the matrix Q of the quadratic objective function, problems defined by a special graph or a logic circuit, and problems characterized by zero duality gap of the SDP relaxation. Examples and geometric illustrations are presented to provide algorithmic and intuitive insights into the problems.
Convex Relaxation and Lagrangian Decomposition for Indefinite Integer Quadratic Programming

X. L. Sun,J. L. Li,H. Z. Luo

DOI: https://doi.org/10.1080/02331930801987607

IF: 2.2

2010-01-01

Optimization

Abstract:We study lower bounding methods for indefinite integer quadratic programming problems. We first construct convex relaxations by D.C. (difference of convex functions) decomposition and linear underestimation. Lagrangian bounds are then derived by applying dual decomposition schemes to separable relaxations. Relationships between the convex relaxation and Lagrangian dual are established. Finally, we prove that the lower bound provided by the convex relaxation coincides with the Lagrangian bound of the orthogonally transformed problem. 1This article is dedicated to the memory of Professor Alex Rubinov.
Lower Bound Improvement and Forcing Rule for Quadratic Binary Programming.

Hong-Xuan Huang,Panos M. Pardalos,Oleg A. Prokopyev

DOI: https://doi.org/10.1007/s10589-005-3062-3

2005-01-01

Computational Optimization and Applications

Abstract:In this paper several equivalent formulations for the quadratic binary programming problem are presented. Based on these formulations we describe four different kinds of strategies for estimating lower bounds of the objective function, which can be integrated into a branch and bound algorithm for solving the quadratic binary programming problem. We also give a theoretical explanation for forcing rules used to branch the variables efficiently, and explore several properties related to obtained subproblems. From the viewpoint of the number of subproblems solved, new strategies for estimating lower bounds are better than those used before. A variant of a depth-first branch and bound algorithm is described and its numerical performance is presented.
A Dual Bounding Framework Through Cost Splitting for Binary Quadratic Optimization

Mahdis Bayani,Borzou Rostami,Yossiri Adulyasak,Louis-Martin Rousseau

DOI: https://doi.org/10.1287/ijoc.2021.0186

IF: 3.288

2024-03-14

INFORMS Journal on Computing

Abstract:Binary quadratic programming (BQP) is a class of combinatorial optimization problems comprising binary variables, quadratic objective functions, and linear/nonlinear constraints. This paper examines a unified framework to reformulate a BQP problem with linear constraints to a new BQP with an exponential number of variables defined on a graph. This framework relies on the concept of stars in the graph to split the quadratic costs into adjacent and nonadjacent components indicating in-star and out-of-star interactions. We exploit the star-based structure of the new reformulation to develop a decomposition-based column generation algorithm. In our computational experiments, we evaluate the performance of our methodology on different applications with different quadratic structures. The quadratic component of the problem is dealt with in the column generation master problem and its subproblem. Results indicate the superiority of the framework over one of the state-of-the-art solvers, GUROBI, when applied to various benchmark reformulations with adjacent-only or sparse quadratic cost matrices. The framework outperforms GUROBI in terms of both dual bound and computational time in almost all instances. History: Accepted by Andrea Lodi, Area Editor for Design & Analysis of Algorithms—Discrete. Funding: The authors thank the Mitacs Accelerate Program for providing funding for this project. In addition, B. Rostami gratefully acknowledges the funding provided by the Canadian Natural Sciences and Engineering Research Council (NSERC) under a Discovery Grant [Grant RGPIN-2020-05395]. Supplemental Material: The online appendix is available at https://doi.org/10.1287/ijoc.2021.0186 .

computer science, interdisciplinary applications,operations research & management science
Compact mixed-integer programming formulations in quadratic optimization

Benjamin Beach,Robert Hildebrand,Joey Huchette

DOI: https://doi.org/10.1007/s10898-022-01184-6

2022-06-14

Journal of Global Optimization

Abstract:We present a technique for producing valid dual bounds for nonconvex quadratic optimization problems. The approach leverages an elegant piecewise linear approximation for univariate quadratic functions due to Yarotsky (Neural Netw 94:103–114, 2017), formulating this (simple) approximation using mixed-integer programming (MIP). Notably, the number of constraints, binary variables, and auxiliary continuous variables used in this formulation grows logarithmically in the approximation error. Combining this with a diagonal perturbation technique to convert a nonseparable quadratic function into a separable one, we present a mixed-integer convex quadratic relaxation for nonconvex quadratic optimization problems. We study the strength (or sharpness ) of our formulation and the tightness of its approximation. Further, we show that our formulation represents feasible points via a Gray code. We close with computational results on problems with quadratic objectives and/or constraints, showing that our proposed method (i) across the board outperforms existing MIP relaxations from the literature, and (ii) on hard instances produces better bounds than exact solvers within a fixed time budget.

mathematics, applied,operations research & management science
An Entropy-Regularized ADMM for Binary Quadratic Programming

Liu Haoming,Deng Kangkang,Liu Haoyang,Wen Zaiwen

DOI: https://doi.org/10.1007/s10898-022-01144-0

2022-01-01

Journal of Global Optimization

Abstract:We propose an entropy regularized splitting model using low-rank factorization for solving binary quadratic programming with linear inequality constraints. Different from the semidefinite programming relaxation model, our model preserves the rank-one constraint and aims to find high quality rank-one solutions directly. The factorization transforms the variables into low-rank matrices, while the entropy term enforces the low-rank property of the splitting variable . A customized alternating direction method of multipliers is utilized to solve the proposed model. Specifically, our method uses the augmented Lagrangian function to deal with inequality constraints, and solves one subproblem on the oblique manifold by a regularized Newton method. Numerical results on the multiple-input multiple-output detection problem, the maxcut problem and the quadratic 0-1 problem indicate that our proposed algorithm has advantage over the SDP methods.
A Mixed-Binary Convex Quadratic Reformulation for Box-Constrained Nonconvex Quadratic Integer Program

Yong Xia,Ying-Wei Han

DOI: https://doi.org/10.48550/arXiv.1401.5881

2014-01-23

Abstract:In this paper, we propose a mixed-binary convex quadratic programming reformulation for the box-constrained nonconvex quadratic integer program and then implement IBM ILOG CPLEX 12.6 to solve the new model. Computational results demonstrate that our approach clearly outperform the very recent state-of-the-art solvers.

Optimization and Control
A Nonlinear Lagrangian Dual For Integer Programming

Yf Xu,D Li

DOI: https://doi.org/10.1016/S0167-6377(02)00166-9

IF: 1.151

2002-01-01

Operations Research Letters

Abstract:Nonlinear Lagrangian theory offers a success guarantee for the dual search via construction of a nonlinear support of the perturbation function at the optimal point. In this paper, a new nonlinear dual formulation of an exponential form is proposed for bounded integer programming. This new formulation possesses an asymptotic strong duality property and guarantees a success in identifying a primal optimum solution. No actual dual search is needed in the solution process when the parameter of the nonlinear Lagrangian formulation is set to be large enough. (C) 2002 Elsevier Science B.V. All rights reserved.
A New Penalty Dual-Primal Augmented Lagrangian Method and Its Extensions

Jie Liu,Xiaoqing Ou,Jiawei Chen

2023-05-06

Abstract:In this paper, we propose a penalty dual-primal augmented lagrangian method for solving convex minimization problems under linear equality or inequality constraints. The proposed method combines a novel penalty technique with updates the new iterates in a dual-primal order, and then be extended to solve multiple-block separable convex programming problems with splitting version and partial splitting version. We establish the convergence analysis for all the introduced algorithm in the lens of variational analysis. Numerical results on the basic pursuit problem and the lasso model are presented to illustrate the efficiency of the proposed method.

Optimization and Control
A Lagrangian Dual Method for Discrete Single-Factor Portfolio Optimization Model

Shen Qiuying,Niu Shufen,Sun Xiaoling

DOI: https://doi.org/10.3969/j.issn.1007-6093.2006.04.006

2006-01-01

Abstract:In this paper, we consider the discrete single-factor model in portfolio optimization. This model is of quadratic integer programs. The separable structure is exploited to derive lower bounds by Lagrangian decomposition scheme. A new branch-and-bound algorithm based on Lagrangian relaxation and continuous relaxation is proposed for this model. Extensive computational results are reported for test problems both from realworld stock market and randomly generated.
Constraint Qualifications for Optimality Conditions and Total Lagrange Dualities in Convex Infinite Programming

D. H. Fang,C. Li,K. F. Ng

DOI: https://doi.org/10.1016/j.na.2010.04.020

IF: 1.743

2010-01-01

Nonlinear Analysis

Abstract:For an inequality system defined by an infinite family of proper convex functions (not necessarily lower semicontinuous), we introduce some new notions of constraint qualifications. Under the new constraint qualifications, we provide necessary and/or sufficient conditions for the KKT rules to hold. Similarly, we provide characterizations for constrained minimization problems to have total Lagrangian dualities. Several known results in the conic programming problem are extended and improved.
Generalized Nonlinear Lagrangian Formulation for Bounded Integer Programming

Yifan Xu,Chunli Liu,Duan Li

DOI: https://doi.org/10.1007/s10898-004-1942-1

2005-01-01

Journal of Global Optimization

Abstract:Several nonlinear Lagrangian formulations have been recently proposed for bounded integer programming problems. While possessing an asymptotic strong duality property, these formulations offer a success guarantee for the identification of an optimal primal solution via a dual search. Investigating common features of nonlinear Lagrangian formulations in constructing a nonlinear support for nonconvex piecewise constant perturbation function, this paper proposes a generalized nonlinear Lagrangian formulation of which many existing nonlinear Lagrangian formulations become special cases.
A Canonical Dual Approach for Solving Linearly Constrained Quadratic Programs

Wenxun Xing,Shu-Cherng Fang,Ruey-Lin Sheu,Ziteng Wang

DOI: https://doi.org/10.1016/j.ejor.2011.09.015

IF: 6.4

2011-01-01

European Journal of Operational Research

Abstract:This paper provides a canonical dual approach for minimizing a general quadratic function over a set of linear constraints. We first perturb the feasible domain by a quadratic constraint, and then solve a "restricted" canonical dual program of the perturbed problem at each iteration to generate a sequence of feasible solutions of the original problem. The generated sequence is proven to be convergent to a Karush-Kuhn-Tucker point with a strictly decreasing objective value. Some numerical results are provided to illustrate the proposed approach. (C) 2011 Elsevier B.V. All rights reserved.
Canonical Dual Solutions to Quadratic Optimization over One Quadratic Constraint.

Wenxun Xing,Shu-Cherng Fang,Ruey-Lin Sheu,Liping Zhang

DOI: https://doi.org/10.1142/s0217595915400072

2015-01-01

Abstract:A quadratic optimization problem with one nonconvex quadratic constraint is studied using the canonical dual approach. Under the dual Slater's condition, we show that the canonical dual has a smooth concave objective function over a convex feasible domain, and this dual has a finite supremum unless the original quadratic optimization problem is infeasible. This supremum, when it exists, always equals to the minimum value of the primal problem. Moreover, a global minimizer of the primal problem can be provided by a dual-to-primal conversion plus a "boundarification" technique. Application to solving a quadratic programming problem over a ball is included and an error bound estimation is provided.
On the Reduction of Duality Gap in Box Constrained Nonconvex Quadratic Program

Yong Xia,Xiaoling Sun,Duan Li,Xiaojin Zheng

DOI: https://doi.org/10.1137/100802153

IF: 2.763

2011-01-01

SIAM Journal on Optimization

Abstract:In this paper, we investigate in this paper the reduction of the duality gap between box constrained nonconvex quadratic programming and its semidefinite programming (SDP) relaxation (or Lagrangian dual). Characterizing the zero duality gap by a set of saddle-point-type conditions, we propose a parameterized distance measure delta(theta) between a polyhedral set C and a perturbed nonconvex set Lambda(theta) to measure the dissatisfaction degree of the optimality conditions for zero duality gap. An underestimation of the duality gap is then derived which leads to a reduction of the duality gap proportional to delta(2)(theta*) for the identified best parameter theta*. This reduction of duality gap can be extended to the cases with both box and linear equality constraints. We demonstrate that the computation of delta(theta*) can be reduced to the cell enumeration of hyperplane arrangement in discrete geometry. In particular, we show that the reduction of duality gap can be achieved in polynomial time for a fixed degeneracy degree of the modified coefficient matrix determined from SDP relaxation.

Parametric Lagrangian Dual for the Binary Quadratic Programming Problem

Improved Estimation of Duality Gap in Binary Quadratic Programming Using a Weighted Distance Measure

Duality Gap Estimation Of Linear Equality Constrained Binary Quadratic Programming

On Duality Gap in Binary Quadratic Programming

Convergent Lagrangian and Contour Cut Method for Nonlinear Integer Programming with a Quadratic Objective Function

An Improved Lower Bound and Approximation Algorithm for Binary Constrained Quadratic Programming Problem

Polynomially Solvable Cases Of Binary Quadratic Programs

Convex Relaxation and Lagrangian Decomposition for Indefinite Integer Quadratic Programming

Lower Bound Improvement and Forcing Rule for Quadratic Binary Programming.

A Dual Bounding Framework Through Cost Splitting for Binary Quadratic Optimization

Compact mixed-integer programming formulations in quadratic optimization

An Entropy-Regularized ADMM for Binary Quadratic Programming

A Mixed-Binary Convex Quadratic Reformulation for Box-Constrained Nonconvex Quadratic Integer Program

A Nonlinear Lagrangian Dual For Integer Programming

A New Penalty Dual-Primal Augmented Lagrangian Method and Its Extensions

A Lagrangian Dual Method for Discrete Single-Factor Portfolio Optimization Model

Constraint Qualifications for Optimality Conditions and Total Lagrange Dualities in Convex Infinite Programming

Generalized Nonlinear Lagrangian Formulation for Bounded Integer Programming

A Canonical Dual Approach for Solving Linearly Constrained Quadratic Programs

Canonical Dual Solutions to Quadratic Optimization over One Quadratic Constraint.

On the Reduction of Duality Gap in Box Constrained Nonconvex Quadratic Program