Abstract:For the large-scale linear discrete ill-posed problem $\min\|Ax-b\|$ or $Ax=b$ with $b$ contaminated by Gaussian white noise, the Lanczos bidiagonalization based Krylov solver LSQR and its mathematically equivalent CGLS, the Conjugate Gradient (CG) method implicitly applied to $A^TAx=A^Tb$, are most commonly used, and CGME, the CG method applied to $\min\|AA^Ty-b\|$ or $AA^Ty=b$ with $x=A^Ty$, and LSMR, which is equivalent to the minimal residual (MINRES) method applied to $A^TAx=A^Tb$, have also been choices. These methods exhibit typical semi-convergence feature, and the iteration number $k$ plays the role of the regularization parameter. However, there has been no definitive answer to the long-standing fundamental question: {\em Can LSQR and CGLS find 2-norm filtering best possible regularized solutions}? The same question is for CGME and LSMR too. At iteration $k$, LSQR, CGME and LSMR compute {\em different} iterates from the {\em same} $k$ dimensional Krylov subspace. A first and fundamental step towards to answering the above question is to {\em accurately} estimate the accuracy of the underlying $k$ dimensional Krylov subspace approximating the $k$ dimensional dominant right singular subspace of $A$. Assuming that the singular values of $A$ are simple, we present a general $\sin\Theta$ theorem for the 2-norm distances between these two subspaces and derive accurate estimates on them for severely, moderately and mildly ill-posed problems. We also establish some relationships between the smallest Ritz values and these distances. Numerical experiments justify the sharpness of our results.

Probabilistic Bounds for the Matrix Condition Number with Extended Lanczos Bidiagonalization

Spectral Condition-Number Estimation of Large Sparse Matrices

Asymptotically Optimal Lower Bounds for the Condition Number of a Real Vandermonde Matrix

On the Condition Number of the Total Least Squares Problem

Structured level-2 condition numbers of matrix functions

A contribution to the condition number of the total least squares problem

The $ω$-Condition Number: Applications to Optimal Preconditioning and Low Rank Generalized Jacobian Updating

Condition number and matrices

Randomized Approximation of the Gram Matrix: Exact Computation and Probabilistic Bounds

The Joint Bidiagonalization Method for Large GSVD Computations in Finite Precision.

Verified Error Bounds for Matrix Decompositions

Error bounds for the approximation of matrix functions with rational Krylov methods

Towards a more robust algorithm for computing the restricted singular value decomposition

Approximation Accuracy of the Krylov Subspaces for Linear Discrete Ill-Posed Problems

Condition Numbers for the K-weighted Pseudoinverse and Their Statistical Estimation

The Joint Bidiagonalization of a Matrix Pair with Inaccurate Inner Iterations

Multiscale estimates for the condition number of non-harmonic Fourier matrices

Suboptimal subspace construction for log-determinant approximation

A generalized skew-symmetric Lanczos bidiagonalization method for computing several extreme eigenpairs of a large skew-symmetric/symmetric positive definite matrix pair