Abstract:It is known that the multiplication of an $N \times M$ matrix with an $M \times P$ matrix can be performed using fewer multiplications than what the naive $NMP$ approach suggests. The most famous instance of this is Strassen's algorithm for multiplying two $2\times 2$ matrices in 7 instead of 8 multiplications. This gives rise to the constraint satisfaction problem of fast matrix multiplication, where a set of $R < NMP$ multiplication terms must be chosen and combined such that they satisfy correctness constraints on the output matrix. Despite its highly combinatorial nature, this problem has not been exhaustively examined from that perspective, as evidenced for example by the recent deep reinforcement learning approach of AlphaTensor. In this work, we propose a simple yet novel Constraint Programming approach to find non-commutative algorithms for fast matrix multiplication or provide proof of infeasibility otherwise. We propose a set of symmetry-breaking constraints and valid inequalities that are particularly helpful in proving infeasibility. On the feasible side, we find that exploiting solver performance variability in conjunction with a sparsity-based problem decomposition enables finding solutions for larger (feasible) instances of fast matrix multiplication. Our experimental results using CP Optimizer demonstrate that we can find fast matrix multiplication algorithms for matrices up to $3\times 3$ in a short amount of time.

Accelerated Multiple Precision Matrix Multiplication using Strassen's Algorithm and Winograd's Variant

Acceleration of complex matrix multiplication using arbitrary precision floating-point arithmetic

Acceleration of Multiple Precision Matrix Multiplication using Ozaki scheme

Performance evaluation of accelerated complex multiple-precision LU decomposition

Acceleration of multiple precision matrix multiplication based on multi-component floating-point arithmetic using AVX2

Accelerated Multiple Precision Direct Method and Mixed Precision Iterative Refinement on Python Programming Environment

Tuning Technique for Multiple Precision Dense Matrix Multiplication using Prediction of Computational Time

Improving the numerical stability of fast matrix multiplication

Strassen's algorithm is not optimally accurate

Methods of Matrix Multiplication: An Overview of Several Methods and their Implementation

Performance Enhancement of the Ozaki Scheme on Integer Matrix Multiplication Unit

Extension of accurate numerical algorithms for matrix multiplication based on error-free transformation

Fast Matrix Multiplication Without Tears: A Constraint Programming Approach

Communication-Optimal Parallel Algorithm for Strassen's Matrix Multiplication

Fast and Practical Strassen's Matrix Multiplication using FPGAs

Matrix Multiplication with Less Arithmetic Complexity and IO Complexity

Implementing Strassen's Algorithm with BLIS

Strassen's Matrix Multiplication Algorithm Is Still Faster

Acceleration of Approximate Matrix Multiplications on GPUs

Implementing LU and Cholesky factorizations on artificial intelligence accelerators

Faster Matrix Multiplication Via Asymmetric Hashing