Abstract:Linear systems in applications are typically well-posed, and yet the coefficient matrices may be nearly singular in that the condition number $\kappa(\boldsymbol{A})$ may be close to $1/\varepsilon_{w}$, where $\varepsilon_{w}$ denotes the unit roundoff of the working precision. It is well known that iterative refinement (IR) can make the forward error independent of $\kappa(\boldsymbol{A})$ if $\kappa(\boldsymbol{A})$ is sufficiently smaller than $1/\varepsilon_{w}$ and the residual is computed in higher precision. We propose a new iterative method, called Forward-and-Backward Stabilized Minimal Residual or FBSMR, by conceptually hybridizing right-preconditioned GMRES (RP-GMRES) with quasi-minimization. We develop FBSMR based on a new theoretical framework of essential-forward-and-backward stability (EFBS), which extends the backward error analysis to consider the intrinsic condition number of a well-posed problem. We stabilize the forward and backward errors in RP-GMRES to achieve EFBS by evaluating a small portion of the algorithm in higher precision while evaluating the preconditioner in lower precision. FBSMR can achieve optimal accuracy in terms of both forward and backward errors for well-posed problems with unpolluted matrices, independently of $\kappa(\boldsymbol{A})$. With low-precision preconditioning, FBSMR can reduce the computational, memory, and energy requirements over direct methods with or without IR. FBSMR can also leverage parallelization-friendly classical Gram-Schmidt in Arnoldi iterations without compromising EFBS. We demonstrate the effectiveness of FBSMR using both random and realistic linear systems.

Towards backward perturbation bounds for approximate dual Krylov subspaces

A Posteriori Error Estimates of Krylov Subspace Approximations to Matrix Functions

Backward errors for multiple eigenpairs in structured and unstructured nonlinear eigenvalue problems

Approximation Accuracy of the Krylov Subspaces for Linear Discrete Ill-Posed Problems

Backward Error Analysis of the Lanczos Bidiagonalization with Reorthogonalization.

New rigorous perturbation bounds for the Cholesky-like factorization of skew-symmetric matrix

Dominant subspace and low-rank approximations from block Krylov subspaces without a prescribed gap

Invariant subspaces of perturbed backward shift

Block subspace expansions for eigenvalues and eigenvectors approximation

Perturbation of Dual Group Generalized Inverse and Group Inverse

Full-rank orthonormal bases for conditionally positive definite kernel-based spaces

Variations of Orthonormal Basis Matrices of Subspaces

Matrix Perturbation: Davis-Kahan in the Infinity Norm

Structured backward error analysis for sparse polynomial eigenvalue problems.

Optimal Solutions of Well-Posed Linear Systems via Low-Precision Right-Preconditioned GMRES with Forward and Backward Stabilization

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

Matrix perturbation analysis of methods for extracting singular values from approximate singular subspaces

Estimating the numerical range with a Krylov subspace

Forward-Backward algorithms for weakly convex problems

Perturbation of the Drazin Inverse for Matrices with Equal Eigenprojections at Zero

New matrix perturbation bounds via combinatorial expansion I: Perturbation of eigenspaces