Abstract:Convex quadratic programming (QP) is an essential class of optimization problems with broad applications across various fields. Traditional QP solvers, typically based on simplex or barrier methods, face significant scalability challenges. In response to these limitations, recent research has shifted towards matrix-free first-order methods to enhance scalability in QP. Among these, the restarted accelerated primal-dual hybrid gradient (rAPDHG) method, proposed by Lu, has gained notable attention due to its linear convergence rate to an optimal solution and its straightforward implementation on Graphics Processing Units (GPUs). Building on this framework, this paper introduces a restarted primal-dual hybrid conjugate gradient (PDHCG) method, which incorporates conjugate gradient (CG) techniques to address the primal subproblems inexactly. We demonstrate that PDHCG maintains a linear convergence rate with an improved convergence constant and is also straightforward to implement on GPUs. Extensive numerical experiments on both synthetic and real-world datasets demonstrate that our method significantly reduces the number of iterations required to achieve the desired accuracy compared to rAPDHG. Additionally, the GPU implementation of our method achieves state-of-the-art performance on large-scale problems. In most large-scale scenarios, our method is approximately 5 times faster than rAPDHG and about 100 times faster than other existing methods. These results highlight the substantial potential of the proposed PDHCG method to greatly improve both the efficiency and scalability of solving complex quadratic programming challenges.

An Accelerated Proximal Gradient-Based Algorithm for Quadratic Programming

An Accelerated Proximal Gradient-based Model Predictive Control Algorithm

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

Accelerated Quasi-Newton Proximal Extragradient: Faster Rate for Smooth Convex Optimization

A Practical and Optimal First-Order Method for Large-Scale Convex Quadratic Programming

Restarted Primal-Dual Hybrid Conjugate Gradient Method for Large-Scale Quadratic Programming

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

More Efficient Accelerated Proximal Algorithm for Nonconvex Problems

Accelerated Proximal Gradient Methods for Nonconvex Programming

A Symplectic Discretization Based Proximal Point Algorithm for Convex Minimization

PIQP: A Proximal Interior-Point Quadratic Programming Solver

An Improved Sequential Quadratic Programming Algorithm for Solving General Nonlinear Programming Problems

A QCQP-based splitting SQP algorithm for two-block nonconvex constrained optimization problems with application

A New SQP Algorithm for Large-Scale Nonlinear Programming

A Proximal-Gradient Method for Constrained Optimization

A new superlinearly convergent algorithm of combining QP subproblem with system of linear equations for nonlinear optimization

A Globally Convergent Stabilized SQP Method

Discrete Gradient-Zeroing Neural Network Algorithms for Handling Future Quadratic Program as well as Robot Arm via Ten-Instant Formula

A variant to Sequential Quadratic Programming for nonlinear Model Predictive Control