Abstract:The harmonic Lanczos bidiagonalization method can be used to compute the smallest singular triplets of a large matrix $A$. We prove that for good enough projection subspaces harmonic Ritz values converge if the columns of $A$ are strongly linearly independent. On the other hand, harmonic Ritz values may miss some desired singular values when the columns of $A$ are almost linearly dependent. Furthermore, harmonic Ritz vectors may converge irregularly and may even fail to converge. Based on the refined projection principle for large matrix eigenproblems due to the first author, we propose a refined harmonic Lanczos bidiagonalization method that takes the Rayleigh quotients of the harmonic Ritz vectors as approximate singular values and extracts the best approximate singular vectors, called the refined harmonic Ritz approximations, from the given subspaces in the sense of residual minimizations. The refined approximations are shown to converge to the desired singular vectors once the subspaces are sufficiently good and the Rayleigh quotients converge. An implicitly restarted refined harmonic Lanczos bidiagonalization algorithm (IRRHLB) is developed. We study how to select the best possible shifts, and suggest refined harmonic shifts that are theoretically better than the harmonic shifts used within the implicitly restarted harmonic Lanczos bidiagonalization algorithm (IRHLB). We propose a novel procedure that can numerically compute the refined harmonic shifts efficiently and accurately. Numerical experiments are reported that compare IRRHLB with five other algorithms based on the Lanczos bidiagonalization process. It appears that IRRHLB is at least competitive with them and can be considerably more efficient when computing the smallest singular triplets.

Linear Convergence of an Algorithm for Largest Singular Value of a Nonnegative Rectangular Tensor

Linear Convergence of an Algorithm for Computing the Largest Eigenvalue of a Nonnegative Tensor.

Singular Values of a Real Rectangular Tensor

Two iterative formulas of largest and smallest singular value of nonsingular matrices

Convergence analysis of the largest and smallest H-eigenvalues for a class of tensor sequences

Primitivity, the Convergence of the NQZ Method, and the Largest Eigenvalue for Nonnegative Tensors.

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

An Efficient GIPM Algorithm for Computing the Smallest V-Singular Value of the Partially Symmetric Tensor

Convergence of a Ulm-like Method for Square Inverse Singular Value Problems with Multiple and Zero Singular Values.

A Note on the Convergence Rate of the Spectral Distributions of Large Random Matrices

Accelerated singular value thresholding for matrix completion.

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors

A simple proof for the almost sure convergence of the largest singular value of a product of Gaussian matrices

A tighter S-type singular value inclusion set for rectangular tensors

Very Large-Scale Singular Value Decomposition Using Tensor Train Networks

A Refined Harmonic Lanczos Bidiagonalization Method and an Implicitly Restarted Algorithm for Computing the Smallest Singular Triplets of Large Matrices

The smallest singular value for rectangular random matrices with Lévy entries

On the Local Convergence of an Iterative Approach for Inverse Singular Value Problems

Some Convergence Results on the Regularized Alternating Least-Squares Method for Tensor Decomposition

Solving the system of nonsingular tensor equations via randomized Kaczmarz-like method

An Inverse Extreme Eigenpair Problem and Its Parallel Iterative Solution for Symmetric Tridiagonal Matrices