Abstract:We study the inversion analog of the well-known Gauss algorithm for multiplying complex matrices. A simple version is $(A + iB)^{-1} = (A + BA^{-1}B)^{-1} - i A^{-1}B(A+BA^{-1} B)^{-1}$ when $A$ is invertible, which may be traced back to Frobenius but has received scant attention. We prove that it is optimal, requiring fewest matrix multiplications and inversions over the base field, and we extend it in three ways: (i) to any invertible $A + iB$ without requiring $A$ or $B$ be invertible; (ii) to any iterated quadratic extension fields, with $\mathbb{C}$ over $\mathbb{R}$ a special case; (iii) to Hermitian positive definite matrices $A + iB$ by exploiting symmetric positive definiteness of $A$ and $A + BA^{-1}B$. We call all such algorithms Frobenius inversions, which we will see do not follow from Sherman--Morrison--Woodbury type identities and cannot be extended to Moore--Penrose pseudoinverse. We show that a complex matrix with well-conditioned real and imaginary parts can be arbitrarily ill-conditioned, a situation tailor-made for Frobenius inversion. We prove that Frobenius inversion for complex matrices is faster than standard inversion by LU decomposition and Frobenius inversion for Hermitian positive definite matrices is faster than standard inversion by Cholesky decomposition. We provide extensive numerical experiments, applying Frobenius inversion to solve linear systems, evaluate matrix sign function, solve Sylvester equation, and compute polar decomposition, showing that Frobenius inversion can be more efficient than LU/Cholesky decomposition with negligible loss in accuracy. A side result is a generalization of Gauss multiplication to iterated quadratic extensions, which we show is intimately related to the Karatsuba algorithm for fast integer multiplication and multidimensional fast Fourier transform.

Integer Levinson Algorithm for the Inversion of any Nonsingular Hermitian Toeplitz Matrix

A positivity preserving inexact Noda iteration for computing the smallest eigenpair of a large irreducible M -matrix

An Inexact Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

An Ulm-like Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

A Ulm-like Method for Inverse Eigenvalue Problems

An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Explicit inverse of symmetric, tridiagonal near Toeplitz matrices Part II: with weakly diagonally dominant Toeplitz

Complex matrix inversion via real matrix inversions

Riemannian Linearized Proximal Algorithms for Nonnegative Inverse Eigenvalue Problem.

On Group Inverse of Singular Toeplitz Matrices

Modified Newton'S Algorithm for Computing the Group Inverses of Singular Toeplitz Matrices

An Inexact Shift‐and‐invert Arnoldi Algorithm for Toeplitz Matrix Exponential

Inexact Shift-and-Invert Arnoldi for Toeplitz Matrix Exponential

Algorithms for Square Root of Semi-Infinite Quasi-Toeplitz M-Matrices

High-Order Block Toeplitz Inner-Bordering method for solving the Gelfand-Levitan-Marchenko equation

Some Recursions on Arnoldi's Method and IOM for Large Non-Hermitian Linear Systems

Explicit formulas for the inverses of Toeplitz matrices, with applications

Explicit inverse of symmetric, tridiagonal near Toeplitz matrices with strictly diagonally dominant Toeplitz part

A Relaxed Algorithm for Online Matrix Inversion

A Convergence Analysis of the Inexact Rayleigh Quotient Iteration and Simplified Jacobi-Davidson Method for the Large Hermitian Matrix Eigenproblem