Abstract:LSQR, a Lanczos bidiagonalization based Krylov subspace iterative method, and its mathematically equivalent conjugate gradient for least squares problems (CGLS) applied to normal equations system, are commonly used for large-scale discrete ill-posed problems. It is well known that LSQR and CGLS have regularizing effects, where the number of iterations plays the role of the regularization parameter. However, it has long been unknown whether the regularizing effects are good enough to find best possible regularized solutions. Here a best possible regularized solution means that it is at least as accurate as the best regularized solution obtained by the truncated singular value decomposition (TSVD) method. We establish bounds for the distance between the k-dimensional Krylov subspace and the k-dimensional dominant right singular space. They show that the Krylov subspace captures the dominant right singular space better for severely and moderately ill-posed problems than for mildly ill-posed problems. Our general conclusions are that LSQR has better regularizing effects for the first two kinds of problems than for the third kind, and a hybrid LSQR with additional regularization is generally needed for mildly ill-posed problems. Exploiting the established bounds, we derive an estimate for the accuracy of the rank k approximation generated by Lanczos bidiagonalization. Numerical experiments illustrate that the regularizing effects of LSQR are good enough to compute best possible regularized solutions for severely and moderately ill-posed problems, stronger than our theory predicts, but they are not for mildly ill-posed problems and additional regularization is needed.

Upper norm bounds for the inverse of locally doubly strictly diagonally dominant matrices with its applications in linear complementarity problems

Schur Complement-Based Infinity Norm Bounds for the Inverse of DSDD Matrices

Error bounds for linear complementarity problems of $ SD{{D}_{1}} $ matrices and $ SD{{D}_{1}} $-$ B $ matrices

Infinity norm upper bounds for the inverse of $ {SDD_k} $ matrices

An infinity norm bound for the inverse of Dashnic–Zusmanovich type matrices with applications

A new error bound for linear complementarity problems for B-matrices

Global Error Bounds for the Extended Vertical Linear Complementarity Problems of CKV-Type Matrices and CKV-Type -Matrices

Schur Complement-Based Infinity Norm Bound for the Inverse of Dashnic-Zusmanovich Type Matrices

Comments on "upper Matrix Bounds for the Discrete Algebraic Riccati Matrix Equation" [with Author's Reply]

Some results on the regularization of LSQR for large-scale discrete ill-posed problems

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

N A ] 5 D ec 2 01 4 Some Results on Regularization of LSQR and CGLS for Large-Scale Discrete Ill-Posed Problems ∗

Explicit inverse of symmetric, tridiagonal near Toeplitz matrices with strictly diagonally dominant Toeplitz part

Explicit inverse of symmetric, tridiagonal near Toeplitz matrices Part II: with weakly diagonally dominant Toeplitz

Upper triangulation-based infinity norm bounds for the inverse of Nekrasov matrices with applications

On the Reduction of Duality Gap in Box Constrained Nonconvex Quadratic Program

Understanding Badly and Well-Behaved Linear Matrix Inequalities Via Semi-infinite Optimization

Diagonal Entries of Inverses of Diagonally Dominant Matrices

Eventually DSDD Matrices and Eigenvalue Localization

Infinity norm bounds for the inverse of Quasi- matrices with applications

Extreme Point Pursuit -- Part II: Further Error Bound Analysis and Applications