Abstract:Convex quadratic programming (QP) is an essential class of optimization problems with broad applications across various fields. Traditional QP solvers, typically based on simplex or barrier methods, face significant scalability challenges. In response to these limitations, recent research has shifted towards matrix-free first-order methods to enhance scalability in QP. Among these, the restarted accelerated primal-dual hybrid gradient (rAPDHG) method, proposed by Lu, has gained notable attention due to its linear convergence rate to an optimal solution and its straightforward implementation on Graphics Processing Units (GPUs). Building on this framework, this paper introduces a restarted primal-dual hybrid conjugate gradient (PDHCG) method, which incorporates conjugate gradient (CG) techniques to address the primal subproblems inexactly. We demonstrate that PDHCG maintains a linear convergence rate with an improved convergence constant and is also straightforward to implement on GPUs. Extensive numerical experiments on both synthetic and real-world datasets demonstrate that our method significantly reduces the number of iterations required to achieve the desired accuracy compared to rAPDHG. Additionally, the GPU implementation of our method achieves state-of-the-art performance on large-scale problems. In most large-scale scenarios, our method is approximately 5 times faster than rAPDHG and about 100 times faster than other existing methods. These results highlight the substantial potential of the proposed PDHCG method to greatly improve both the efficiency and scalability of solving complex quadratic programming challenges.

A Feasible Descent Decomposition Algorithm for Large-scale Quadratic Programming

A decomposition algorithm for solving large-scale quadratic programming problems

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

Solving Convex Quadratic Programming by Potential-Reduction Interior-Point Algorithm

A distributed decomposition algorithm for solving large-scale mixed integer programming problem

A NEW ALGORITHM OF LARGE-SCALE QUADRATIC PROGRAMMING SOLUTION FOR FINITE ELEMENT METHOD

A NEW DESCENT ALGORITHM FOR SOLVING QUADRATIC BILEVEL PROGRAMMING PROBLEMS

Outsourcing Large-Scale Quadratic Programming to A Public Cloud

A New Decomposition Method for Fully Non-Separable Large-Scale Problem

A Successive Quadratic Programming Algorithm with Inequality and Equality Constraint

A Distributed Algorithm for High-Dimension Convex Quadratically Constrained Quadratic Programs

A New Algorithm for Finding Global Solution of Indefinite Quadratic Programming Problems

A multilevel algorithm for large unconstrained binary quadratic optimization

A Successive quadratic Programming Algorithm with Global and superlinear Convergence Properties

Mixed Second Order Partial Derivatives Decomposition Method for Large Scale Optimization

A Feasible Decomposition Method for Constrained Equations and Its Application to Complementarity Problems

Scalable Primal Decomposition Schemes for Large-Scale Infrastructure Networks

Global Convergence Analysis of Decomposition Methods for Support Vector Regression

Nested Primal-Dual Decomposition Method Based on CPLEX

An Efficient Sequential Quadratic Programming Algorithm For Nonlinear Programming

Restarted Primal-Dual Hybrid Conjugate Gradient Method for Large-Scale Quadratic Programming