Abstract:LSQR, a Lanczos bidiagonalization based Krylov subspace iterative method, and its mathematically equivalent conjugate gradient for least squares problems (CGLS) applied to normal equations system, are commonly used for large-scale discrete ill-posed problems. It is well known that LSQR and CGLS have regularizing effects, where the number of iterations plays the role of the regularization parameter. However, it has long been unknown whether the regularizing effects are good enough to find best possible regularized solutions. Here a best possible regularized solution means that it is at least as accurate as the best regularized solution obtained by the truncated singular value decomposition (TSVD) method. We establish bounds for the distance between the k-dimensional Krylov subspace and the k-dimensional dominant right singular space. They show that the Krylov subspace captures the dominant right singular space better for severely and moderately ill-posed problems than for mildly ill-posed problems. Our general conclusions are that LSQR has better regularizing effects for the first two kinds of problems than for the third kind, and a hybrid LSQR with additional regularization is generally needed for mildly ill-posed problems. Exploiting the established bounds, we derive an estimate for the accuracy of the rank k approximation generated by Lanczos bidiagonalization. Numerical experiments illustrate that the regularizing effects of LSQR are good enough to compute best possible regularized solutions for severely and moderately ill-posed problems, stronger than our theory predicts, but they are not for mildly ill-posed problems and additional regularization is needed.

Developing LSQR Method for Sylvester Quaternion Tensor Equations

ON THE PURE IMAGINARY QUATERNIONIC LEAST SQUARES SOLUTIONS OF MATRIX EQUATION

A New Implementation of LSMR Algorithm for the Quaternionic Least Squares Problem

LSQR Iterative Method for Generalized Coupled Sylvester Matrix Equations

Quaternion kernel recursive least-squares algorithm

Iterative Methods for Least Squares Problem in Split Quaternionic Mechanics

An Iterative Algorithm for Least Squares Problem in Quaternionic Quantum Theory

Exact and least-squares solutions of a generalized Sylvester-transpose matrix equation over generalized quaternions

STP Method for Solving the Least Squares Special Solutions of Quaternion Matrix Equations

A metric function for dual quaternion matrices and related least-squares problems

A QR DECOMPOSITION BASED SOLVER FOR THE LEAST SQUARES PROBLEMS FROM THE MINIMAL RESIDUAL METHOD FOR THE SYLVESTER EQUATION

(R,S)-(Skew) Symmetric Solutions to Matrix Equation AXB=C over Quaternions

Developing iterative algorithms to solve Sylvester tensor equations

Research on Least‐Square η ‐Hermitian Solutions of Split Quaternion Matrix Equations

$L_{2,1}$-Norm Regularized Quaternion Matrix Completion Using Sparse Representation and Quaternion QR Decomposition

A System of Tensor Equations over the Dual Split Quaternion Algebra with an Application

A new real structure-preserving quaternion QR algorithm

Solving the QLY Least Squares Problem of Dual Quaternion Matrix Equation Based on STP of Dual Quaternion Matrices

Efficient quaternion CUR method for low-rank approximation to quaternion matrix

Discrete cosine transform LSQR and GMRES methods for multidimensional ill-posed problems

Some results on the regularization of LSQR for large-scale discrete ill-posed problems