Abstract:For the large-scale linear discrete ill-posed problem $\min\|Ax-b\|$ or $Ax=b$ with $b$ contaminated by Gaussian white noise, the Lanczos bidiagonalization based Krylov solver LSQR and its mathematically equivalent CGLS, the Conjugate Gradient (CG) method implicitly applied to $A^TAx=A^Tb$, are most commonly used, and CGME, the CG method applied to $\min\|AA^Ty-b\|$ or $AA^Ty=b$ with $x=A^Ty$, and LSMR, which is equivalent to the minimal residual (MINRES) method applied to $A^TAx=A^Tb$, have also been choices. These methods exhibit typical semi-convergence feature, and the iteration number $k$ plays the role of the regularization parameter. However, there has been no definitive answer to the long-standing fundamental question: {\em Can LSQR and CGLS find 2-norm filtering best possible regularized solutions}? The same question is for CGME and LSMR too. At iteration $k$, LSQR, CGME and LSMR compute {\em different} iterates from the {\em same} $k$ dimensional Krylov subspace. A first and fundamental step towards to answering the above question is to {\em accurately} estimate the accuracy of the underlying $k$ dimensional Krylov subspace approximating the $k$ dimensional dominant right singular subspace of $A$. Assuming that the singular values of $A$ are simple, we present a general $\sin\Theta$ theorem for the 2-norm distances between these two subspaces and derive accurate estimates on them for severely, moderately and mildly ill-posed problems. We also establish some relationships between the smallest Ritz values and these distances. Numerical experiments justify the sharpness of our results.

Convergence Properties Of Krylov Subspace Methods For Singular Linear Systems With Arbitrary Index

Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

The Convergence of Krylov Subspace Methods for Large Unsymmetric Linear Systems

Approximation Accuracy of the Krylov Subspaces for Linear Discrete Ill-Posed Problems

Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Index Splitting for the Drazin Inverse and the Singular Linear System

The Krylov Subspaces, Low Rank Approximations and Ritz Values of LSQR for Linear Discrete Ill-Posed Problems: the Multiple Singular Value Case

Index splitting for the Drazin inverse and the singular linear system1Supported by Doctoral Point Foundation of China and National Natural Science Foundation of China. 1

Convergence and Quotient Convergence of Iterative Methods for Solving Singular Linear Equations with Index One

Newton-type Methods for Inverse Singular Value Problems with Multiple Singular Values

Dominant subspace and low-rank approximations from block Krylov subspaces without a prescribed gap

Regularization Properties of Krylov Iterative Solvers CGME and LSMR for Linear Discrete Ill-Posed Problems with an Application to Truncated Randomized SVDs

A Non-Krylov subspace Method for Solving Large and Sparse Linear System of Equations

On Convergence of the Inexact Rayleigh Quotient Iteration with the Lanczos Method Used for Solving Linear Systems

A Projection Method Based on Extended Krylov Subspaces for Solving Sylvester Equations

On Krylov subspace methods for skew-symmetric and shifted skew-symmetric linear systems

A two-step algorithm for solving singular linear systems with index one.

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

The Convergence of Generalized Lanczos Methods for Large Unsymmetric Eigenproblems

Obtaining the pseudoinverse solution of singular range-symmetric linear systems with GMRES-type methods

The Low Rank Approximations and Ritz Values in LSQR for Linear Discrete Ill-Posed Problem*