Abstract:In recent years, there has been growing interest in solving linear optimization problems - or more simply "LP" - using first-order methods. The restarted primal-dual hybrid gradient method (PDHG) - together with some heuristic techniques - has emerged as a powerful tool for solving huge-scale LPs. However, the theoretical understanding of it and the validation of various heuristic implementation techniques are still very limited. Existing complexity analyses have relied on the Hoffman constant of the LP KKT system, which is known to be overly conservative, difficult to compute (and hence difficult to empirically validate), and fails to offer insight into instance-specific characteristics of the LP problems. These limitations have limited the capability to discern which characteristics of LP instances lead to easy versus difficult LP. With the goal of overcoming these limitations, in this paper we introduce and develop two purely geometry-based condition measures for LP instances: the "limiting error ratio" and the LP sharpness. We provide new computational guarantees for the restarted PDHG based on these two condition measures. For the limiting error ratio, we provide a computable upper bound and show its relationship with the data instance's proximity to infeasibility under perturbation. For the LP sharpness, we prove its equivalence to the stability of the LP optimal solution set under perturbation of the objective function. We validate our computational guarantees in terms of these condition measures via specially constructed instances. Conversely, our computational guarantees validate the practical efficacy of certain heuristic techniques (row preconditioners and step-size tuning) that improve computational performance in practice. Finally, we present computational experiments on LP relaxations from the MIPLIB dataset that demonstrate the promise of various implementation strategies.

Faster first-order primal-dual methods for linear programming using restarts and sharpness

On the Relation Between LP Sharpness and Limiting Error Ratio and Complexity Implications for Restarted PDHG

Computational Guarantees for Restarted PDHG for LP based on "Limiting Error Ratios" and LP Sharpness

Nearly Optimal Linear Convergence of Stochastic Primal-Dual Methods for Linear Programming

Accessible Theoretical Complexity of the Restarted Primal-Dual Hybrid Gradient Method for Linear Programs with Unique Optima

On the Geometry and Refined Rate of Primal-Dual Hybrid Gradient for Linear Programming

Restarted Halpern PDHG for Linear Programming

Practical Large-Scale Linear Programming using Primal-Dual Hybrid Gradient

Accelerated nonlinear primal-dual hybrid gradient methods with applications to supervised machine learning

Restarts subject to approximate sharpness: A parameter-free and optimal scheme for first-order methods

Restart of accelerated first order methods with linear convergence under a quadratic functional growth condition

Infeasibility Detection with Primal-Dual Hybrid Gradient for Large-Scale Linear Programming

A Practical and Optimal First-Order Method for Large-Scale Convex Quadratic Programming

A primal-dual interior-point relaxation method with global and rapidly local convergence for nonlinear programs

Faster Accelerated First-order Methods for Convex Optimization with Strongly Convex Function Constraints

Acceleration of Primal–Dual Methods by Preconditioning and Simple Subproblem Procedures

On the Infimal Sub-differential Size of Primal-Dual Hybrid Gradient Method and Beyond

A Fast Single-Loop Primal-Dual Algorithm for Non-Convex Functional Constrained Optimization

Local Linear Convergence Analysis of Primal–Dual Splitting Methods

Optimal Primal-Dual Methods for a Class of Saddle Point Problems

When Does Primal Interior Point Method Beat Primal-dual in Linear Optimization?