Abstract:The factorization of skew-symmetric matrices is a critically understudied area of dense linear algebra (DLA), particularly in comparison to that of symmetric matrices. While some algorithms can be adapted from the symmetric case, the cost of algorithms can be reduced by exploiting skew-symmetry. A motivating example is the factorization $X=LTL^T$ of a skew-symmetric matrix $X$, which is used in practical applications as a means of determining the determinant of $X$ as the square of the (cheaply-computed) Pfaffian of the skew-symmetric tridiagonal matrix $T$, for example in fields such as quantum electronic structure and machine learning. Such applications also often require pivoting in order to improve numerical stability. In this work we explore a combination of known literature algorithms and new algorithms recently derived using formal methods. High-performance parallel CPU implementations are created, leveraging the concept of fusion at multiple levels in order to reduce memory traffic overhead, as well as the BLIS framework which provides high-performance GEMM kernels, hierarchical parallelism, and cache blocking. We find that operation fusion and improved use of available bandwidth via parallelization of bandwidth-bound (level-2 BLAS) operations are essential for obtaining high performance, while a concise C++ implementation provides a clear and close connection to the formal derivation process without sacrificing performance.

A Backward Stable Algorithm for Computing the CS Decomposition via the Polar Decomposition

Adaptive Parallelizable Algorithms for Interpolative Decompositions via Partially Pivoted LU

History and generality of the CS decomposition

Fast and backward stable computation of the eigenvalues and eigenvectors of matrix polynomials

Distributed-Memory Randomized Algorithms for Sparse Tensor CP Decomposition

Towards a more robust algorithm for computing the restricted singular value decomposition

Partial orthogonal rank-one decomposition of complex symmetric tensors based on the Takagi factorization

Symmetric tensor decomposition by an iterative eigendecomposition algorithm

Subspace power method for symmetric tensor decomposition

Canonical Polyadic Decomposition via the generalized Schur decomposition

On SVD and Polar Decomposition in Real and Complexified Clifford Algebras

Limited Memory Block Krylov Subspace Optimization for Computing Dominant Singular Value Decompositions.

The Hadamard decomposition problem

Computational complexity of decomposing a symmetric matrix as a sum of positive semidefinite and diagonal matrices

Skew-Symmetric Matrix Decompositions on Shared-Memory Architectures

Making matrices better: Geometry and topology of polar and singular value decomposition

A Backward Stable Algorithm for Quadratic Eigenvalue Problems

Computational Polarization: An Information-Theoretic Method for Resilient Computing

A Nonlinear GMRES Optimization Algorithm for Canonical Tensor Decomposition

Randomized Complete Pivoting for Solving Symmetric Indefinite Linear Systems