Abstract:The factorization of skew-symmetric matrices is a critically understudied area of dense linear algebra (DLA), particularly in comparison to that of symmetric matrices. While some algorithms can be adapted from the symmetric case, the cost of algorithms can be reduced by exploiting skew-symmetry. A motivating example is the factorization $X=LTL^T$ of a skew-symmetric matrix $X$, which is used in practical applications as a means of determining the determinant of $X$ as the square of the (cheaply-computed) Pfaffian of the skew-symmetric tridiagonal matrix $T$, for example in fields such as quantum electronic structure and machine learning. Such applications also often require pivoting in order to improve numerical stability. In this work we explore a combination of known literature algorithms and new algorithms recently derived using formal methods. High-performance parallel CPU implementations are created, leveraging the concept of fusion at multiple levels in order to reduce memory traffic overhead, as well as the BLIS framework which provides high-performance GEMM kernels, hierarchical parallelism, and cache blocking. We find that operation fusion and improved use of available bandwidth via parallelization of bandwidth-bound (level-2 BLAS) operations are essential for obtaining high performance, while a concise C++ implementation provides a clear and close connection to the formal derivation process without sacrificing performance.

Symmetries of matrix multiplication algorithms. I

Finite matrix multiplication algorithms from infinite groups

Faster Matrix Multiplication Via Asymmetric Hashing

Communication Lower Bounds and Optimal Algorithms for Symmetric Matrix Computations

Improving the numerical stability of fast matrix multiplication

Fast Matrix Multiplication Without Tears: A Constraint Programming Approach

More Asymmetry Yields Faster Matrix Multiplication

Fast algorithms for the solution of perturbed symmetric Toeplitz linear system and its applications

A non-commutative algorithm for multiplying (7 $\times$ 7) matrices using 250 multiplications

Strassen's algorithm is not optimally accurate

Correction of 'J. Laderman, V. Pan, X.–H. Sha, On practical Algorithms for Accelerated Matrix Multiplication, Linear Algebra and its Applications. Vol. 162-164 (1992) pp. 557-588'

Communication-Optimal Parallel Algorithm for Strassen's Matrix Multiplication

Skew-Symmetric Matrix Decompositions on Shared-Memory Architectures

Ruling Out Low-rank Matrix Multiplication Tensor Decompositions with Symmetries via SAT

Exploitation of symmetry in graphs with applications to finite and boundary elements analysis

Algorithms for matrix multiplication via sampling and opportunistic matrix multiplication

Matrix Multiplication with Less Arithmetic Complexity and IO Complexity

Algorithms for structured matrix-vector product of optimal bilinear complexity

Fast Algorithm for Multiplication on the Skein Algebra of One-hole Torus

Improved Algorithms for Alternating Matrix Space Isometry: from Theory to Practice