Abstract:We study the inversion analog of the well-known Gauss algorithm for multiplying complex matrices. A simple version is $(A + iB)^{-1} = (A + BA^{-1}B)^{-1} - i A^{-1}B(A+BA^{-1} B)^{-1}$ when $A$ is invertible, which may be traced back to Frobenius but has received scant attention. We prove that it is optimal, requiring fewest matrix multiplications and inversions over the base field, and we extend it in three ways: (i) to any invertible $A + iB$ without requiring $A$ or $B$ be invertible; (ii) to any iterated quadratic extension fields, with $\mathbb{C}$ over $\mathbb{R}$ a special case; (iii) to Hermitian positive definite matrices $A + iB$ by exploiting symmetric positive definiteness of $A$ and $A + BA^{-1}B$. We call all such algorithms Frobenius inversions, which we will see do not follow from Sherman--Morrison--Woodbury type identities and cannot be extended to Moore--Penrose pseudoinverse. We show that a complex matrix with well-conditioned real and imaginary parts can be arbitrarily ill-conditioned, a situation tailor-made for Frobenius inversion. We prove that Frobenius inversion for complex matrices is faster than standard inversion by LU decomposition and Frobenius inversion for Hermitian positive definite matrices is faster than standard inversion by Cholesky decomposition. We provide extensive numerical experiments, applying Frobenius inversion to solve linear systems, evaluate matrix sign function, solve Sylvester equation, and compute polar decomposition, showing that Frobenius inversion can be more efficient than LU/Cholesky decomposition with negligible loss in accuracy. A side result is a generalization of Gauss multiplication to iterated quadratic extensions, which we show is intimately related to the Karatsuba algorithm for fast integer multiplication and multidimensional fast Fourier transform.

Fast Computation of Moore-Penrose Inverse Matrices

Good and Fast Row-Sparse ah-Symmetric Reflexive Generalized Inverses

Recurrent Neural Networks For Computing Weighted Moore-Penrose Inverse

Convergence of Rump’s Method for Computing the Moore-Penrose Inverse

The Fast Algorithms for Finding the Inverses and Generalized Inverses of Resultant Matrices

Computing Moore-Penrose Inverses of Toeplitz Matrices by Newton's Iteration

Inverse and Moore–Penrose inverse of conditional matrices via convolution

A fast convergent iterative solver for approximate inverse of matrices

Noise-tolerant neural algorithm for online solving time-varying full-rank matrix Moore–Penrose inverse problems: A control-theoretic approach

Recurrent neural networks for computing weighted Moore-Penrose inverse1This project is supported by the National Nature Science Foundation of China, Doctoral Point Foundation of China and Youth Science Foundation of Universities in Shanghai of China.1

Neural incomplete factorization: learning preconditioners for the conjugate gradient method

Interval iterative methods for computing Moore-Penrose inverse

Computing Low-Rank Approximation of a Dense Matrix on Multicore CPUs with a GPU and Its Application to Solving a Hierarchically Semiseparable Linear System of Equations

An $N \log N$ Parallel Fast Direct Solver for Kernel Matrices

Complex matrix inversion via real matrix inversions

Multimodal Moore-Penrose Inverse-Based Recomputation Framework for Big Data Analysis

Adaptive Factored Incomplete Inverse Matrices

Fast Matrix Multiplication Without Tears: A Constraint Programming Approach

Neural Acceleration of Incomplete Cholesky Preconditioners

Sparse Factorization of Large Square Matrices

Reviving pseudo-inverses: Asymptotic properties of large dimensional Moore-Penrose and Ridge-type inverses with applications