Abstract:For a high dimensional problem, a randomized Gram-Schmidt (RGS) algorithm is beneficial in computational costs as well as numerical stability. We apply this dimension reduction technique by random sketching to Krylov subspace methods, e.g. to the generalized minimal residual method (GMRES). We propose a flexible variant of GMRES with the randomized Gram-Schmidt–based Arnoldi iteration to produce a set of basis vectors of the Krylov subspace. Even though the Krylov basis is no longer l2$$l_2$$ orthonormal, its random projection onto the low dimensional space achieves l2$$l_2$$ orthogonality. As a result, the numerical stability is observed which turns out to be independent of the dimension of the problem even in extreme scale problems. On the other hand, as the harmonic Ritz values are commonly used in GMRES with deflated restarting to improve convergence, we consider another deflation strategy, for instance disregarding the singular vectors associated with the smallest singular values. We thus introduce a new algorithm of the randomized flexible GMRES with singular value decomposition (SVD)–based deflated restarting. At the end, we carry out numerical experiments in the context of compressible turbulent flow simulations. Our proposed approach exhibits a quite competitive numerical behaviour to existing methods while reducing computational costs.

Solving Shifted Linear Systems with Restarted GMRES Augmented with Error Approximations.

Global GMRES with Deflated Restarting for Families of Shifted Linear Systems

Restarted GMRES Method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations

A Block GMRES Method with Deflated Restarting for Solving Linear Systems with Multiple Shifts and Multiple Right-Hand Sides

A flexible and adaptive Simpler GMRES with deflated restarting for shifted linear systems

GMRES with randomized sketching and deflated restarting

A spectrally preconditioned and initially deflated variant of the restarted block GMRES method for solving multiple right-hand sides linear systems

Flexible and deflated variants of the block shifted GMRES method

Block GMRES Method with Inexact Breakdowns and Deflated Restarting

Restarted Hessenberg Method for Solving Shifted Nonsymmetric Linear Systems

Restarted Generalized Krylov Subspace Methods for Solving Large-Scale Polynomial Eigenvalue Problems

Restarted Simpler GMRES Augmented with Harmonic Ritz Vectors and Approximate Errors

Deflated GMRES for systems with multiple shifts and multiple right-hand sides

A Simpler GMRES and Its Adaptive Variant for Shifted Linear Systems.

Randomized flexible GMRES with deflated restarting

Iterative Solution of Multi-Shifted Linear Systems with Multiple Right-Hand Sides.

On restarted and deflated block FOM and GMRES methods for sequences of shifted linear systems

Accelerate Weighted Gmres by Augmenting Error Approximations

Restarted Generalized Second-Order Krylov Subspace Methods for Solving Quadratic Eigenvalue Problems

On IGMRES: an Incomplete Generalized Minimal Residual Method for Large Unsymmetric Linear Systems

Restarted Hessenberg Method for Shifted Nonsymmetric Linear Systems with Applications to Fractional Differential Equations