Abstract:Quadratic programs (QPs) arise in various domains such as machine learning, finance, and control. Recently, learning-enhanced primal-dual hybrid gradient (PDHG) methods have shown great potential in addressing large-scale linear programs; however, this approach has not been extended to QPs. In this work, we focus on unrolling "PDQP", a PDHG algorithm specialized for convex QPs. Specifically, we propose a neural network model called "PDQP-net" to learn optimal QP solutions. Theoretically, we demonstrate that a PDQP-net of polynomial size can align with the PDQP algorithm, returning optimal primal-dual solution pairs. We propose an unsupervised method that incorporates KKT conditions into the loss function. Unlike the standard learning-to-optimize framework that requires optimization solutions generated by solvers, our unsupervised method adjusts the network weights directly from the evaluation of the primal-dual gap. This method has two benefits over supervised learning: first, it helps generate better primal-dual gap since the primal-dual gap is in the objective function; second, it does not require solvers. We show that PDQP-net trained in this unsupervised manner can effectively approximate optimal QP solutions. Extensive numerical experiments confirm our findings, indicating that using PDQP-net predictions to warm-start PDQP can achieve up to 45% acceleration on QP instances. Moreover, it achieves 14% to 31% acceleration on out-of-distribution instances.

On the Simplified LVI-based Primal-Dual Neural Network for Solving LP and QP Problems

Performance analysis of LVI-based PDNN applied to real-time solution of time-varying quadratic programming

Time-varying Linear Programming Via LVI-PDNN with Numerical Examples

Towards Piecewise-Linear Primal Neural Networks For Optimization And Redundant Robotics

An LVI-based Numerical Algorithm for Solving Quadratic Programming Problems

On a Primal-Dual Neural Network for Online

Inverse-free Dual Neural Networks for Online Solution of Strictly Convex Quadratic Programming.

Solving for a Quadratic Programming with a Quadratic Constraint Based on a Neural Network Frame

A Simple And High Performance Neural Network For Quadratic Programming Problems

A discrete-time neural network for optimization problems with hybrid constraints.

A Lower Dimension Zeroing Neural Network for Time-Variant Quadratic Programming Applied to Robot Pose Control

A Parallel Method With Hybrid Algorithms For Mixed Integer Nonlinear Programming

A Unified Predefined-Time Convergent and Robust ZNN Model for Constrained Quadratic Programming

Bi-Criteria Acceleration Minimization of Redundant Robot Manipulators Using New Problem Formulation and Lvi-Based Primal-Dual Neural Network

A New Neural Network for Solving Quadratic Programming Problems with Equality and Inequality Constraints.

A New Delayed Projection Neural Network for Solving Linear Variational Inequalities and Quadratic Optimization Problems

Joint angle drift problem of PUMA560 robot arm solved by a simplified LVI-based primal-dual neural network

More illustrative investigation on window-shaped obstacle avoidance of robot manipulators using a simplified LVI-based primal-dual neural network

An Improved Neural Network For Solving Optimization Of Quadratic Programming Problems

Primal-dual Interior Point QP-free Algorithm for Nonlinear Constrained Optimization

An Efficient Unsupervised Framework for Convex Quadratic Programs via Deep Unrolling