Abstract:Quadratic programming (QP) forms a crucial foundation in optimization, encompassing a broad spectrum of domains and serving as the basis for more advanced algorithms. Consequently, as the scale and complexity of modern applications continue to grow, the development of efficient and reliable QP algorithms is becoming increasingly vital. In this context, this paper introduces a novel deep learning-aided distributed optimization architecture designed for tackling large-scale QP problems. First, we combine the state-of-the-art Operator Splitting QP (OSQP) method with a consensus approach to derive DistributedQP, a new method tailored for network-structured problems, with convergence guarantees to optimality. Subsequently, we unfold this optimizer into a deep learning framework, leading to DeepDistributedQP, which leverages learned policies to accelerate reaching to desired accuracy within a restricted amount of iterations. Our approach is also theoretically grounded through Probably Approximately Correct (PAC)-Bayes theory, providing generalization bounds on the expected optimality gap for unseen problems. The proposed framework, as well as its centralized version DeepQP, significantly outperform their standard optimization counterparts on a variety of tasks such as randomly generated problems, optimal control, linear regression, transportation networks and others. Notably, DeepDistributedQP demonstrates strong generalization by training on small problems and scaling to solve much larger ones (up to 50K variables and 150K constraints) using the same policy. Moreover, it achieves orders-of-magnitude improvements in wall-clock time compared to OSQP. The certifiable performance guarantees of our approach are also demonstrated, ensuring higher-quality solutions over traditional optimizers.

Q-linear Convergence of Distributed Optimization with Barzilai-Borwein Step Sizes

An Accelerated Algorithm for Distributed Optimization with Barzilai-Borwein Step Sizes

Distributed adaptive Newton methods with global superlinear convergence

Distributed Adaptive Newton Methods with Globally Superlinear Convergence

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

Distributed Optimization Algorithm with Superlinear Convergence Rate

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Achieving Globally Superlinear Convergence for Distributed Optimization with Adaptive Newton Method

Linear Convergence for Distributed Stochastic Optimization with Coupled Inequality Constraints

Scalable Distributed Least Square Algorithms for Large-Scale Linear Equations Via an Optimization Approach

Distributed Variable Sample-size Stochastic Optimization with Fixed Step-sizes

Distributed Constrained Optimization with Linear Convergence Rate

Quantized Distributed Nonconvex Optimization Algorithms with Linear Convergence under the Polyak--$Ł$ojasiewicz Condition

Distributed Optimization with Quantized Gradient Descent

Linear Convergence of Primal-Dual Gradient Methods and their Performance in Distributed Optimization

Linear convergence of decentralized estimation for statistical estimation using gradient method

Deep Distributed Optimization for Large-Scale Quadratic Programming

Linearly Convergent Second-Order Distributed Optimization Algorithms

(Rectified Version) The Barzilai-Borwein Method for Distributed Optimization over Unbalanced Directed Networks

Quantized Distributed Gradient Tracking Algorithm with Linear Convergence in Directed Networks

A Communication-efficient Linearly Convergent Algorithm with Variance Reduction for Distributed Stochastic Optimization