Abstract:The harmonic Lanczos bidiagonalization method can be used to compute the smallest singular triplets of a large matrix $A$. We prove that for good enough projection subspaces harmonic Ritz values converge if the columns of $A$ are strongly linearly independent. On the other hand, harmonic Ritz values may miss some desired singular values when the columns of $A$ are almost linearly dependent. Furthermore, harmonic Ritz vectors may converge irregularly and may even fail to converge. Based on the refined projection principle for large matrix eigenproblems due to the first author, we propose a refined harmonic Lanczos bidiagonalization method that takes the Rayleigh quotients of the harmonic Ritz vectors as approximate singular values and extracts the best approximate singular vectors, called the refined harmonic Ritz approximations, from the given subspaces in the sense of residual minimizations. The refined approximations are shown to converge to the desired singular vectors once the subspaces are sufficiently good and the Rayleigh quotients converge. An implicitly restarted refined harmonic Lanczos bidiagonalization algorithm (IRRHLB) is developed. We study how to select the best possible shifts, and suggest refined harmonic shifts that are theoretically better than the harmonic shifts used within the implicitly restarted harmonic Lanczos bidiagonalization algorithm (IRHLB). We propose a novel procedure that can numerically compute the refined harmonic shifts efficiently and accurately. Numerical experiments are reported that compare IRRHLB with five other algorithms based on the Lanczos bidiagonalization process. It appears that IRRHLB is at least competitive with them and can be considerably more efficient when computing the smallest singular triplets.

On Convergence of the Inexact Rayleigh Quotient Iteration with the Lanczos Method Used for Solving Linear Systems

On Convergence of the Inexact Rayleigh Quotient Iteration with MINRES.

A Convergence Analysis of the Inexact Rayleigh Quotient Iteration and Simplified Jacobi-Davidson Method for the Large Hermitian Matrix Eigenproblem

On the Convergence of the Accelerated Riccati Iteration Method.

Rayleigh Quotient Iteration, cubic convergence, and second covariant derivative

A complex-projected Rayleigh quotient iteration for targeting interior eigenvalues

An Inexact Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

Local Convergence of Inexact Methods under the Hölder Condition

Convergence of Q-Ritz Pairs, Refined Q-Ritz Vectors and Q-Rayleigh-ritz Method for Quadratic Eigenvalue Problems

An analysis of the Rayleigh-Ritz and refined Rayleigh-Ritz methods for regular nonlinear eigenvalue problems

On the Convergence of Ritz Pairs and Refined Ritz Vectors for Quadratic Eigenvalue Problems

Inner Iterations in the Shift-Invert Residual Arnoldi Method and the Jacobi-Davidson Method

2D Eigenvalue Problem III: Convergence Analysis of the 2D Rayleigh Quotient Iteration

A Ulm-like Method for Inverse Eigenvalue Problems

The Low Rank Approximations and Ritz Values in LSQR for Linear Discrete Ill-Posed Problem*

On Rayleigh Quotient Iteration for Dual Quaternion Hermitian Eigenvalue Problem

A Refined Harmonic Lanczos Bidiagonalization Method and an Implicitly Restarted Algorithm for Computing the Smallest Singular Triplets of Large Matrices

The Convergence of Generalized Lanczos Methods for Large Unsymmetric Eigenproblems

The Krylov Subspaces, Low Rank Approximations and Ritz Values of LSQR for Linear Discrete Ill-Posed Problems: the Multiple Singular Value Case

Approximation Accuracy of the Krylov Subspaces for Linear Discrete Ill-Posed Problems

A Convergence Analysis on the Iterative Trace Ratio Algorithm and Its Refinements