Abstract:Algebraic matrix multiplication algorithms are designed by bounding the rank of matrix multiplication tensors, and then using a recursive method. However, designing algorithms in this way quickly leads to large constant factors: if one proves that the tensor for multiplying $n \times n$ matrices has rank $\leq t$, then the resulting recurrence shows that $M \times M$ matrices can be multiplied using $O(n^2 \cdot M^{\log_n t})$ operations, where the leading constant scales proportionally to $n^2$. Even modest increases in $n$ can blow up the leading constant too much to be worth the slight decrease in the exponent of $M$. Meanwhile, the asymptotically best algorithms use very large $n$, such that $n^2$ is larger than the number of atoms in the visible universe! In this paper, we give new ways to use tensor rank bounds to design matrix multiplication algorithms, which lead to smaller leading constants than the standard recursive method. Our main result shows that, if the tensor for multiplying $n \times n$ matrices has rank $\leq t$, then $M \times M$ matrices can be multiplied using only $n^{O(1/(\log n)^{0.33})} \cdot M^{\log_n t}$ operations. In other words, we improve the leading constant in general from $O(n^2)$ to $n^{O(1/(\log n)^{0.33})} < n^{o(1)}$. We then apply this and further improve the leading constant in a number of situations of interest. We show that, in the popularly-conjectured case where $\omega=2$, a new, different recursive approach can lead to an improvement. We also show that the leading constant of the current asymptotically fastest matrix multiplication algorithm, and any algorithm designed using the group-theoretic method, can be further improved by taking advantage of additional structure of the underlying tensor identities.

The iterated Aluthge transforms of a matrix converge

Limit of iteration of the induced Aluthge transformations of centered operators

Projective convergence of columns for inhomogeneous products of matrices with nonnegative entries

Modified and accelerated relaxed gradient-based iterative algorithms for the complex conjugate and transpose matrix equations

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

An Ulm-like Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

Algebra of L-Banded Matrices

Some Convergence Results on the Regularized Alternating Least-Squares Method for Tensor Decomposition

On the convergence of complex Jacobi methods

Improving the Leading Constant of Matrix Multiplication

Regular matrices of unbounded linear operators

A new approach to strong convergence

A Convergence Analysis on the Iterative Trace Ratio Algorithm and Its Refinements

On linear algebra of r-Hankel and r-Toeplitz matrices with geometric sequence

Deformed single ring theorems

Convergence of the Relative Gain Array of the Matrix A = alpha I-3 + beta J(3)

From Poincaré Inequalities to Nonlinear Matrix Concentration

Convergence Analysis of the Doubling Algorithm for Several Nonlinear Matrix Equations in the Critical Case.

Joint spectra of spherical Aluthge transforms of commuting n-tuples of Hilbert space operators

The Spectral Picture and Joint Spectral Radius of the Generalized Spherical Aluthge Transform