Abstract:In recent years, there has been growing interest in solving linear optimization problems - or more simply "LP" - using first-order methods. The restarted primal-dual hybrid gradient method (PDHG) - together with some heuristic techniques - has emerged as a powerful tool for solving huge-scale LPs. However, the theoretical understanding of it and the validation of various heuristic implementation techniques are still very limited. Existing complexity analyses have relied on the Hoffman constant of the LP KKT system, which is known to be overly conservative, difficult to compute (and hence difficult to empirically validate), and fails to offer insight into instance-specific characteristics of the LP problems. These limitations have limited the capability to discern which characteristics of LP instances lead to easy versus difficult LP. With the goal of overcoming these limitations, in this paper we introduce and develop two purely geometry-based condition measures for LP instances: the "limiting error ratio" and the LP sharpness. We provide new computational guarantees for the restarted PDHG based on these two condition measures. For the limiting error ratio, we provide a computable upper bound and show its relationship with the data instance's proximity to infeasibility under perturbation. For the LP sharpness, we prove its equivalence to the stability of the LP optimal solution set under perturbation of the objective function. We validate our computational guarantees in terms of these condition measures via specially constructed instances. Conversely, our computational guarantees validate the practical efficacy of certain heuristic techniques (row preconditioners and step-size tuning) that improve computational performance in practice. Finally, we present computational experiments on LP relaxations from the MIPLIB dataset that demonstrate the promise of various implementation strategies.

Mean-performance of Sharp Restart II: Inequality Roadmap

Choosing restart strategy at partial knowledge of process statistics

Constructing efficient strategies for the process optimization by restart

Optimal stochastic restart renders fluctuations in first passage times universal

On the universal properties of stochastic processes under optimally tuned Poisson restart

Restarts subject to approximate sharpness: A parameter-free and optimal scheme for first-order methods

Restarting Algorithms: Sometimes there is Free Lunch

Competing random searchers under restarts

On the Relation Between LP Sharpness and Limiting Error Ratio and Complexity Implications for Restarted PDHG

Stochastic resetting prevails over sharp restart for broad target distributions

Efficiency of a Stochastic Search with Punctual and Costly Restarts

Drift-diffusive resetting search process with stochastic returns: speed-up beyond optimal instantaneous return

Restart Strategy Selection using Machine Learning Techniques

Towards Ultra Rapid Restarts

From Understanding Genetic Drift to a Smart-Restart Mechanism for Estimation-of-Distribution Algorithms

Analysis of Two Restart Algorithms.

Faster first-order primal-dual methods for linear programming using restarts and sharpness

Smart Resetting: An Energy-Efficient Strategy for Stochastic Search Processes

Optimizing the tie-breaker regression discontinuity design

Computational Guarantees for Restarted PDHG for LP based on "Limiting Error Ratios" and LP Sharpness

Adaptive Resetting for Informed Search Strategies and the Design of Non-equilibrium Steady-states