Abstract:Invariance transformations of polyadic decompositions of matrix multiplication tensors define an equivalence relation on the set of such decompositions. In this paper, we present an algorithm to efficiently decide whether two polyadic decompositions of a given matrix multiplication tensor are equivalent. With this algorithm, we analyze the equivalence classes of decompositions of several matrix multiplication tensors. This analysis is relevant for the study of fast matrix multiplication as it relates to the question of how many essentially different fast matrix multiplication algorithms there exist. This question has been first studied by de~Groote, who showed that for the multiplication of $2\times2$ matrices with $7$ active multiplications, all algorithms are essentially equivalent to Strassen's algorithm. In contrast, the results of our analysis show that for the multiplication of larger matrices, (e.g., $2\times3$ by $3\times2$ or $3\times3$ by $3\times3$ matrices), two decompositions are very likely to be essentially different. We further provide a necessary criterion for a polyadic decomposition to be equivalent to a polyadic decomposition with integer entries. Decompositions with specific integer entries, e.g., powers of two, provide fast matrix multiplication algorithms with better efficiency and stability properties. This condition can be tested algorithmically and we present the conclusions obtained for the decompositions of small/medium matrix multiplication tensors.

Three decompositions of symmetric tensors have similar condition numbers

The condition number of many tensor decompositions is invariant under Tucker compression

Undercomplete Decomposition of Symmetric Tensors in Linear Time, and Smoothed Analysis of the Condition Number

The average condition number of most tensor rank decomposition problems is infinite

Rank Decomposition and Symmetric Rank Decomposition over Arbitrary Fields

Symmetry & Critical Points for Symmetric Tensor Decomposition Problems

Equivalent Polyadic Decompositions of Matrix Multiplication Tensors

Partial orthogonal rank-one decomposition of complex symmetric tensors based on the Takagi factorization

Iterative Methods for Symmetric Outer Product Tensor Decompositions

Decomposition of Big Tensors With Low Multilinear Rank

Multiplicative Algorithms for Symmetric Nonnegative Tensor Factorizations and Its Applications.

Computational complexity of decomposing a symmetric matrix as a sum of positive semidefinite and diagonal matrices

The Symmetric Rank and Decomposition of M-Order N-Dimensional (n = 2,3,4) Symmetric Tensors over the Binary Field

Generalized cyclic symmetric decompositions for the matrix multiplication tensor

Triple Decomposition and Tensor Recovery of Third Order Tensors

Characterization of Decomposition of Matrix Multiplication Tensors

Symmetric Tensor Decompositions On Varieties

L1-norm Tucker Tensor Decomposition

Scalable Symmetric Tucker Tensor Decomposition

Completely positive tensor decomposition

An algebraic algorithm for the ParaTuck-2 decomposition