Abstract:In this paper, we introduce an HPR-LP solver, an implementation of a Halpern Peaceman-Rachford (HPR) method with semi-proximal terms for solving linear programming (LP). The HPR method enjoys the iteration complexity of $O(1/k)$ in terms of the Karush-Kuhn-Tucker residual and the objective error. Based on the complexity results, we design an adaptive strategy of restart and penalty parameter update to improve the efficiency and robustness of the HPR method. We conduct extensive numerical experiments on different LP benchmark datasets using NVIDIA A100-SXM4-80GB GPU in different stopping tolerances. Our solver's Julia version achieves a $\textbf{2.39x}$ to $\textbf{5.70x}$ speedup measured by SGM10 on benchmark datasets with presolve ($\textbf{2.03x}$ to $\textbf{4.06x}$ without presolve) over the award-winning solver PDLP with the tolerance of $10^{-8}$.
What problem does this paper attempt to address?
This paper attempts to solve the efficient solution methods for linear programming (LP) problems. Specifically, the authors introduce a solver based on the Halpern Peaceman - Rachford (HPR) method - HPR - LP, which is used to solve large - scale linear programming problems.
### Main problems and goals
1. **Improve solution efficiency and robustness**:
- The paper introduces the HPR method with a semi - proximal term, which has an iterative complexity of \(O(1/k)\) in terms of the Karush - Kuhn - Tucker (KKT) residual and the objective error.
- To further improve efficiency and robustness, an adaptive restart strategy and penalty parameter update rules are designed.
2. **Numerical experiment verification**:
- Through extensive numerical experiments on different benchmark datasets, the effectiveness and superiority of the HPR - LP solver are verified.
- The experiments use NVIDIA A100 - SXM4 - 80GB GPU and are compared with the award - winning solver PDLP.
3. **Performance improvement**:
- The Julia version of HPR - LP achieves a speedup of 2.39 to 5.70 times on the pre - processed benchmark datasets (2.03 to 4.06 times on the un - pre - processed datasets), especially performing excellently under a tolerance of \(10^{-8}\).
- At the same precision, HPR - LP successfully solves more problems and has a significant advantage compared to cuPDLP.jl.
### Mathematical formula representation
The following are the key formulas involved in the paper:
- Formal description of the linear programming problem:
\[
\min_{x \in \mathbb{R}^n} \langle c, x \rangle
\]
\[
\text{s.t. } A_1 x = b_1, \quad A_2 x \geq b_2, \quad x \in C
\]
where \(A_1 \in \mathbb{R}^{m_1\times n}, A_2 \in \mathbb{R}^{m_2\times n}, b_1 \in \mathbb{R}^{m_1}, b_2 \in \mathbb{R}^{m_2}, c \in \mathbb{R}^n\), and \(C := \{x \in \mathbb{R}^n\mid l \leq x \leq u\}\).
- Dual problem:
\[
\min_{y \in \mathbb{R}^m, z \in \mathbb{R}^n} -\langle b, y \rangle + \delta_D(y) + \delta_C^*(-z)
\]
\[
\text{s.t. } A^* y + z = c
\]
- Augmented Lagrangian function:
\[
L_\sigma(y, z; x) := -\langle b, y \rangle + \delta_D(y) + \delta_C^*(-z) + \langle x, A^* y + z - c \rangle + \frac{\sigma}{2}\|A^* y + z - c\|^2
\]
- Iterative complexity:
\[
\left\|R(\bar{w}_{k + 1})\right\| \leq \frac{(\sigma (\|A^*\|+\|\sqrt{T_1}\|)+ 1/\sqrt{\sigma})R_0}{k + 1}
\]
\[
\left(-\frac{1}{\sqrt{\sigma}}\|x^*\|\right)\frac{R_0}{k + 1} \leq h(\bar{