Abstract:The k-step Lanczos bidiagonalization reduces a matrix A∈Rm×n into a bidiagonal form Bk∈R(k+1)×k while generating two orthonormal matrices Uk+1∈Rm×(k+1) and Vk+1∈Rn×(k+1). However, any practical implementation of the algorithm suffers from loss of orthogonality of Uk+1 and Vk+1 due to the presence of rounding errors, and several reorthogonalization strategies are proposed to maintain some level of orthogonality. In this paper, we make a backward error analysis of the Lanczos bidiagonalization with reorthogonalization (LBRO) by writing various reorthogonalization strategies in a general form. Our results show that the computed Bk by the k-step LBRO of A with starting vector b is the exact one generated by the k-step Lanczos bidiagonalization of A+E with starting vector b+δb (denoted by LB(A+E,b+δb)), where the 2-norm of perturbation vector/matrix δb and E depend on the roundoff unit and orthogonality levels of Uk+1 and Vk+1. The results also show that the 2-norm of Uk+1−Ūk+1 and Vk+1−V̄k+1 are controlled by the orthogonality levels of Uk+1 and Vk+1, respectively, where Ūk+1 and V̄k+1 are the two orthonormal matrices generated by the k-step LB(A+E,b+δb) in exact arithmetic. Thus, the k-step LBRO is mixed forward–backward stable as long as the orthogonality of Uk+1 and Vk+1 are good enough. We use this result to investigate the backward stability of LBRO based SVD computation algorithm and LSQR algorithm. Numerical experiments confirm our results.

Stability Analysis of the Two-level Orthogonal Arnoldi Procedure

A Refined Second-order Arnoldi (RSOAR) Method for the Quadratic Eigenvalue Problem and Implicit Restarting

SOAR: A Second-order Arnoldi Method for the Solution of the Quadratic Eigenvalue Problem.

Second-order Krylov Subspace and Arnoldi Procedure

IMPLICITLY RESTARTED GENERALIZED SECOND-ORDER ARNOLDI TYPE ALGORITHMS FOR THE QUADRATIC EIGENVALUE PROBLEM

Dimension Reduction of Large-Scale Second-Order Dynamical Systems Via a Second-Order Arnoldi Method

Structure-preserved MOR Method for Coupled Systems Via Orthogonal Polynomials and Arnoldi Algorithm

Arnoldi model reduction method based on implicitly restarted Krylov-Schur technology

Arnoldi-based Model Order Reduction for Linear Systems with Inhomogeneous Initial Conditions

Model-order Reduction of Large-Scale Kth-Order Linear Dynamical Systems Via a Kth-Order Arnoldi Method

Restarted Generalized Second-Order Krylov Subspace Methods for Solving Quadratic Eigenvalue Problems

The Second-Order Biorthogonalization Procedure and Its Application to Quadratic Eigenvalue Problems

Structure Preserving Balanced Proper Orthogonal Decomposition for Second-Order Form Systems Via Shifted Legendre Polynomials

Stable and Orthonormal OJA Algorithm with Low Complexity

Analyzing Vector Orthogonalization Algorithms

A Two-Directional Arnoldi Process and Its Application to Parametric Model Order Reduction

A Structured Quasi-Arnoldi Procedure for Model Order Reduction of Second-Order Systems

On the backward stability of s-step GMRES

Polynomial characterizations of the approximate eigenvectors by the refined Arnoldi method and an implicitly restarted refined Arnoldi algorithm

Backward Error Analysis of the Lanczos Bidiagonalization with Reorthogonalization.

Dimension Reduction for K-Power Bilinear Systems Using Orthogonal Polynomials and Arnoldi Algorithm.