Abstract:We present a randomized, inverse-free algorithm for producing an approximate diagonalization of any $n \times n$ matrix pencil $(A,B)$. The bulk of the algorithm rests on a randomized divide-and-conquer eigensolver for the generalized eigenvalue problem originally proposed by Ballard, Demmel, and Dumitriu [Technical Report 2010]. We demonstrate that this divide-and-conquer approach can be formulated to succeed with high probability provided the input pencil is sufficiently well-behaved, which is accomplished by generalizing the recent pseudospectral shattering work of Banks, Garza-Vargas, Kulkarni, and Srivastava [Foundations of Computational Mathematics 2022]. In particular, we show that perturbing and scaling $(A,B)$ regularizes its pseudospectra, allowing divide-and-conquer to run over a simple random grid and in turn producing an accurate diagonalization of $(A,B)$ in the backward error sense. The main result of the paper states the existence of a randomized algorithm that with high probability (and in exact arithmetic) produces invertible $S,T$ and diagonal $D$ such that $||A - SDT^{-1}||_2 \leq \varepsilon$ and $||B - ST^{-1}||_2 \leq \varepsilon$ in at most $O \left(\log^2 \left( \frac{n}{\varepsilon} \right) T_{\text{MM}}(n) \right)$ operations, where $T_{\text{MM}}(n)$ is the asymptotic complexity of matrix multiplication. This not only provides a new set of guarantees for highly parallel generalized eigenvalue solvers but also establishes nearly matrix multiplication time as an upper bound on the complexity of inverse-free, exact arithmetic matrix pencil diagonalization.

An incomplete tridiagonalization-based determinant evaluation for a generalized periodic tridiagonal matrix

Numerical algorithms for the fast and reliable solution of periodic tridiagonal Toeplitz linear systems

Divided Differences and a Unified Approach to Evaluating Determinants Involving Generalized Factorials

An efficient breakdown-free algorithm for numerically evaluating the determinants of (p, q)-pentadiagonal matrices

An efficient numerical algorithm for solving linear systems with cyclic tridiagonal coefficient matrices

Parallelization of incomplete factorization preconditioning of block tridiagonal linear systems with 1-D domain decomposition

The Generalized Triangular Decomposition.

Application of quasideterminants to the inverse of block triangular matrices over noncommutative rings

A Hybrid Numerical Algorithm for Evaluating n-th Order Tridiagonal Determinants

Evaluating Matrix Functions by Resummations on Graphs: the Method of Path-Sums

Tridiagonal and single-pair matrices and the inverse sum of two single-pair matrices

Determinants and Inverses of banded Toeplitz Matrices over $\mathbb{F}_p$ Are Periodic

Multigrid method for symmetric Toeplitz tridiagonal matrix: Convergence analysis and application to fractional Feynman-Kac equation

Parallel incomplete factorization preconditioning of block tridiagonal linear systems with 2-D domain decomposition

(T,S) Splitting Methods For Computing The Generalized Inverse A((2))T,S And Rectangular Systems

A general alternating direction implicit iteration method for solving complex symmetric linear systems

Accurate Computation of Exponentials of Triangular Essentially Non-negative Matrices

Constrained solutions of generalized coupled discrete-time periodic matrix equations with application in state observer design for linear periodic systems

Generalizing the Fréchet Derivative Algorithm for the Matrix Exponential

Generalized Pseudospectral Shattering and Inverse-Free Matrix Pencil Diagonalization