Abstract:Krylov subspace methods are extensively used in scientific computing to solve large-scale linear systems. However, the performance of these iterative Krylov solvers on modern supercomputers is limited by expensive communication costs. The $s$-step strategy generates a series of $s$ Krylov vectors at a time to avoid communication. Asymptotically, the $s$-step approach can reduce communication latency by a factor of $s$. Unfortunately, due to finite-precision implementation, the step size has to be kept small for stability. In this work, we tackle the numerical instabilities encountered in the $s$-step GMRES algorithm. By choosing an appropriate polynomial basis and block orthogonalization schemes, we construct a communication avoiding $s$-step GMRES algorithm that automatically selects the optimal step size to ensure numerical stability. To further maximize communication savings, we introduce scaled Newton polynomials that can increase the step size $s$ to a few hundreds for many problems. An initial step size estimator is also developed to efficiently choose the optimal step size for stability. The guaranteed stability of the proposed algorithm is demonstrated using numerical experiments. In the process, we also evaluate how the choice of polynomial and preconditioning affects the stability limit of the algorithm. Finally, we show parallel scalability on more than 114,000 cores in a distributed-memory setting. Perfectly linear scaling has been observed in both strong and weak scaling studies with negligible communication costs.

A flexible and adaptive Simpler GMRES with deflated restarting for shifted linear systems

A Simpler GMRES and Its Adaptive Variant for Shifted Linear Systems.

Flexible and deflated variants of the block shifted GMRES method

Global GMRES with Deflated Restarting for Families of Shifted Linear Systems

Solving Shifted Linear Systems with Restarted GMRES Augmented with Error Approximations.

A Block GMRES Method with Deflated Restarting for Solving Linear Systems with Multiple Shifts and Multiple Right-Hand Sides

Deflated GMRES for systems with multiple shifts and multiple right-hand sides

A Deflated Block Flexible Gmres-Dr Method for Linear Systems with Multiple Right-Hand Sides

On restarted and deflated block FOM and GMRES methods for sequences of shifted linear systems

A spectrally preconditioned and initially deflated variant of the restarted block GMRES method for solving multiple right-hand sides linear systems

Improving GMRES(m) Using an Adaptive Switching Controller

Randomized flexible GMRES with deflated restarting

Block GMRES Method with Inexact Breakdowns and Deflated Restarting

Restarted Hessenberg Method for Solving Shifted Nonsymmetric Linear Systems

A Proportional-Derivative Control Strategy for Restarting the GMRES(m) Algorithm.

Weighted and deflated global GMRES algorithms for solving large Sylvester matrix equations

GMRES with randomized sketching and deflated restarting

Deflated Iterative Methods for Linear Equations with Multiple Right-Hand Sides

A numerically stable communication-avoiding s-step GMRES algorithm

Restarted Simpler GMRES Augmented with Harmonic Ritz Vectors and Approximate Errors

Restarted GMRES Method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations