Abstract:The details of a solver for minimizing a strictly convex quadratic objective function subject to general linear constraints are presented. The method uses a gradient projection algorithm enhanced with subspace acceleration to solve the bound-constrained dual optimization problem. Such gradient projection methods are well-known, but are typically employed to solve the primal problem when only simple bound-constraints are present. The main contributions of this work are threefold. First, we address the challenges associated with solving the dual problem, which is usually a convex problem even when the primal problem is strictly convex. In particular, for the dual problem, one must efficiently compute directions of infinite descent when they exist, which is precisely when the primal formulation is infeasible. Second, we show how the linear algebra may be arranged to take computational advantage of sparsity that is often present in the second-derivative matrix, mostly by showing how sparse updates may be performed for algorithmic quantities. We consider the case that the second-derivative matrix is explicitly available and sparse, and the case when it is available implicitly via a limited memory BFGS representation. Third, we present the details of our Fortran 2003 software package DQP, which is part of the GALAHAD suite of optimization routines. Numerical tests are performed on quadratic programming problems from the combined CUTEst and Maros and Meszaros test sets.

Subgradient Projection Method with Variable Diameter for Optimization

Subgradient Projection Algorithms for Convex Feasibility on Riemannian Manifolds with Lower Bounded Curvatures

Global Optimization Algorithm Based on Lagrangian Dual

O(log T) Projections for Stochastic Optimization of Smooth and Strongly Convex Functions

On the Surrogate Gradient Algorithm for Lagrangian Relaxation

An Infeasible-Point Subgradient Method Using Adaptive Approximate Projections

A dual gradient-projection method for large-scale strictly convex quadratic problems

The Saddle-Gradient Method for Linear Constrained Convex Programming

Scalable Projection-Free Optimization Methods via MultiRadial Duality Theory

Proximal Gradient/Semismooth Newton Methods for Projection Onto a Polyhedron Via the Duality-Gap-Active-Set Strategy

Efficient Projected Gradient Methods for L 0 Constrained Optimization

A Proximal-Gradient Method for Constrained Optimization

Projection and contraction method with double inertial steps for quasi-monotone variational inequalities

Optimal Stochastic Strongly Convex Optimization with a Logarithmic Number of Projections

Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization

Stochastic Block-Coordinate Gradient Projection Algorithms for Submodular Maximization.

Random Multi-Constraint Projection: Stochastic Gradient Methods for Convex Optimization with Many Constraints

Fuzzy Subgradient Algorithm for Solving Lagrangian Relaxation Dual Problem

A modified subgradient extragradient method with non-monotonic step sizes for solving quasimonotone variational inequalities

Novel projected gradient methods for solving pseudomontone variational inequality problems with applications to optimal control problems

Modified Projection Method For General Variational Inequalities