Abstract:Linear systems in applications are typically well-posed, and yet the coefficient matrices may be nearly singular in that the condition number $\kappa(\boldsymbol{A})$ may be close to $1/\varepsilon_{w}$, where $\varepsilon_{w}$ denotes the unit roundoff of the working precision. It is well known that iterative refinement (IR) can make the forward error independent of $\kappa(\boldsymbol{A})$ if $\kappa(\boldsymbol{A})$ is sufficiently smaller than $1/\varepsilon_{w}$ and the residual is computed in higher precision. We propose a new iterative method, called Forward-and-Backward Stabilized Minimal Residual or FBSMR, by conceptually hybridizing right-preconditioned GMRES (RP-GMRES) with quasi-minimization. We develop FBSMR based on a new theoretical framework of essential-forward-and-backward stability (EFBS), which extends the backward error analysis to consider the intrinsic condition number of a well-posed problem. We stabilize the forward and backward errors in RP-GMRES to achieve EFBS by evaluating a small portion of the algorithm in higher precision while evaluating the preconditioner in lower precision. FBSMR can achieve optimal accuracy in terms of both forward and backward errors for well-posed problems with unpolluted matrices, independently of $\kappa(\boldsymbol{A})$. With low-precision preconditioning, FBSMR can reduce the computational, memory, and energy requirements over direct methods with or without IR. FBSMR can also leverage parallelization-friendly classical Gram-Schmidt in Arnoldi iterations without compromising EFBS. We demonstrate the effectiveness of FBSMR using both random and realistic linear systems.

Restarted Global FOM and GMRES Algorithms for the Stein-like Matrix Equationx+m(x)=c

A global variant of the COCR method for the complex symmetric Sylvester matrix equation AX + XB = C

Gl-QFOM and Gl-QGMRES: two efficient algorithms for quaternion linear systems with multiple right-hand sides

Inexact Global FOM and GMRES Methods for Solving Linear Systems with Multiple Right-Hand Sides

Restarted Generalized Krylov Subspace Methods for Solving Large-Scale Polynomial Eigenvalue Problems

On IGMRES: an Incomplete Generalized Minimal Residual Method for Large Unsymmetric Linear Systems

Block GMRES Method with Inexact Breakdowns and Deflated Restarting

On the backward stability of s-step GMRES

A spectrally preconditioned and initially deflated variant of the restarted block GMRES method for solving multiple right-hand sides linear systems

Restarted Generalized Second-Order Krylov Subspace Methods for Solving Quadratic Eigenvalue Problems

Weighted and deflated global GMRES algorithms for solving large Sylvester matrix equations

A Global Harmonic Arnoldi Method for Large Non-Hermitian Eigenproblems with an Application to Multiple Eigenvalue Problems

A sketch-and-project method for solving the matrix equation AXB = C

A Proportional-Derivative Control Strategy for Restarting the GMRES(m) Algorithm.

Stationary splitting iterative methods for the matrix equation A X B = C

A New Method for Solving Matrix Equation AXB + CXT D = E

Optimization methods for solving matrix equations

Optimal Solutions of Well-Posed Linear Systems via Low-Precision Right-Preconditioned GMRES with Forward and Backward Stabilization

The Sherman–Morrison–Woodbury formula for generalized linear matrix equations and applications

Improving GMRES(m) Using an Adaptive Switching Controller

GMRES with randomized sketching and deflated restarting