Abstract:Rapid convergence of the shifted QR algorithm on symmetric matrices was shown more than fifty years ago. Since then, despite significant interest and its practical relevance, an understanding of the dynamics and convergence properties of the shifted QR algorithm on nonsymmetric matrices has remained elusive. We introduce a new family of shifting strategies for the Hessenberg shifted QR algorithm. We prove that when the input is a diagonalizable Hessenberg matrix $H$ of bounded eigenvector condition number $\kappa_V(H)$ -- defined as the minimum condition number of $V$ over all diagonalizations $VDV^{-1}$ of $H$ -- then the shifted QR algorithm with a certain strategy from our family is guaranteed to converge rapidly to a Hessenberg matrix with a zero subdiagonal entry, in exact arithmetic. Our convergence result is nonasymptotic, showing that the geometric mean of certain subdiagonal entries of $H$ decays by a fixed constant in every $QR$ iteration. The arithmetic cost of implementing each iteration of our strategy scales roughly logarithmically in the eigenvector condition number $\kappa_V(H)$, which is a measure of the nonnormality of $H$. The key ideas in the design and analysis of our strategy are: (1) We are able to precisely characterize when a certain shifting strategy based on Ritz values stagnates. We use this information to design certain ``exceptional shifts'' which are guaranteed to escape stagnation whenever it occurs. (2) We use higher degree shifts (of degree roughly $\log \kappa_V(H)$) to dampen transient effects due to nonnormality, allowing us to treat nonnormal matrices in a manner similar to normal matrices.

An improved Shifted CholeskyQR based on columns

CholeskyQR for sparse matrices

Probabilistic error analysis of CholeskyQR based on columns

Analysis of Randomized Householder-Cholesky QR Factorization with Multisketching

Fast Moving Window Algorithm for QR and Cholesky Decompositions

A Novel Randomized XR-Based Preconditioned CholeskyQR Algorithm

QR factorization of ill-conditioned tall-and-skinny matrices on distributed-memory systems

A New Shift of the QL Algorithm for Irreducible Symmetric Tridiagonal Matrices

Deterministic and randomized LU-Householder CholeskyQR

A randomized preconditioned Cholesky-QR algorithm

A new real structure-preserving quaternion QR algorithm

CholeskyQR with Randomization and Pivoting for Tall Matrices (CQRRPT)

Global Convergence of Hessenberg Shifted QR I: Exact Arithmetic

Algorithm 1019: A Task-based Multi-shift QR/QZ Algorithm with Aggressive Early Deflation

QMRCGstab Algorithm for Families of Shifted Linear Systems

A Quadratically Convergent QR-like Method Without Shifts for the Hermitian Eigenvalue Problem

A Shifted Method for Solving Symmetric Eigenvalue Problems

A SQMRCGstab Algorithm for Families of Shifted Linear Systems

On aggressive early deflation in parallel variants of the QR algorithm

Implementing Communication-Optimal Parallel and Sequential QR Factorizations

A stable one-synchronization variant of reorthogonalized block classical Gram--Schmidt