Abstract:The dynamic matrix inverse problem is to maintain the inverse of a matrix undergoing element and column updates. It is the main subroutine behind the best algorithms for many dynamic problems whose complexity is not yet well-understood, such as maintaining the largest eigenvalue, rank and determinant of a matrix and maintaining reachability, distances, maximum matching size, and k-paths/cycles in a graph. Understanding the complexity of dynamic matrix inverse is a key to understand these problems. In this paper, we present (i) improved algorithms for dynamic matrix inverse and their extensions to some incremental/look-ahead variants, and (ii) variants of the Online Matrix-Vector conjecture [Henzinger et al. STOC’15] that, if true, imply that these algorithms are tight. Our algorithms automatically lead to faster dynamic algorithms for the aforementioned problems, some of which are also tight under our conjectures, e.g. reachability and maximum matching size (closing the gaps for these two problems was in fact asked by Abboud and V. Williams [FOCS’14]). Prior best bounds for most of these problems date back to more than a decade ago [Sankowski FOCS’04, COCOON’05, SODA’07; Kavitha FSTTCS’08; Mucha and Sankowski Algorithmica’10; Bosek et al. FOCS’14]. Our improvements stem mostly from the ability to use fast matrix multiplication "one more time", to maintain a certain transformation matrix which could be maintained only combinatorially previously (i.e. without fast matrix multiplication). Oddly, unlike other dynamic problems where this approach, once successful, could be repeated several times ("bootstrapping"), our conjectures imply that this is not the case for dynamic matrix inverse and some related problems. However, when a small additional "look-ahead" information is provided we can perform such repetition to drive the bounds down further.

A Relaxed Algorithm for Online Matrix Inversion

Latest Inversion-Free Iterative Scheme for Solving a Pair of Nonlinear Matrix Equations

On iterative solvers of the matrix equation X+ATX-1 A=I

Solving Dense Linear Systems Faster Than via Preconditioning

Dynamic Matrix Inverse: Improved Algorithms and Matching Conditional Lower Bounds

On iterative solvers of the matrix equation X+A/sup T/X/sup -1/A=I

Combinatorial and Recurrent Approaches for Efficient Matrix Inversion: Sub-cubic algorithms leveraging Fast Matrix products

Complex matrix inversion via real matrix inversions

Matrix Pencil Optimal Iterative Algorithms and Restarted Versions for Linear Matrix Equation and Pseudoinverse

Efficient Computation for Invertibility Sequence of Banded Toeplitz Matrices

Generalized Inverses and a Block-Rank Equation.

Good and Fast Row-Sparse ah-Symmetric Reflexive Generalized Inverses

A Variation on the Block Arnoldi Method for Large Unsymmetric Matrix Eigenproblems

An Efficient Gauss--Newton Algorithm for Symmetric Low-Rank Product Matrix Approximations

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations

A sketch-and-project method for solving the matrix equation AXB = C

Stabilization of a matrix via a low-rank-adaptive ODE

Iterative methods for solving factorized linear systems

On the Convergence of the Randomized Block Kaczmarz Algorithm for Solving a Matrix Equation

The Bit Complexity of Dynamic Algebraic Formulas and their Determinants

The Noncommutative Edmonds' Problem Re-visited