Abstract:We propose efficient parallel algorithms and implementations on shared memory architectures of LU factorization over a finite field. Compared to the corresponding numerical routines, we have identified three main difficulties specific to linear algebra over finite fields. First, the arithmetic complexity could be dominated by modular reductions. Therefore, it is mandatory to delay as much as possible these reductions while mixing fine-grain parallelizations of tiled iterative and recursive algorithms. Second, fast linear algebra variants, e.g., using Strassen-Winograd algorithm, never suffer from instability and can thus be widely used in cascade with the classical algorithms. There, trade-offs are to be made between size of blocks well suited to those fast variants or to load and communication balancing. Third, many applications over finite fields require the rank profile of the matrix (quite often rank deficient) rather than the solution to a linear system. It is thus important to design parallel algorithms that preserve and compute this rank profile. Moreover, as the rank profile is only discovered during the algorithm, block size has then to be dynamic. We propose and compare several block decomposition: tile iterative with left-looking, right-looking and Crout variants, slab and tile recursive. Experiments demonstrate that the tile recursive variant performs better and matches the performance of reference numerical software when no rank deficiency occur. Furthermore, even in the most heterogeneous case, namely when all pivot blocks are rank deficient, we show that it is possbile to maintain a high efficiency.

Efficient Inverse Cholesky Factorization for Alamouti Matrices in G-Stbc and Alamouti-Like Matrices in Omp

Efficient Implementations for Orthogonal Matching Pursuit

Fast Moving Window Algorithm for QR and Cholesky Decompositions

Efficient Implementations of Orthogonal Matching Pursuit Based on Inverse Cholesky Factorization

Parallel Cholesky Factorization for Banded Matrices using OpenMP Tasks

A Fast Recursive Algorithm for G-STBC

Parallelization and scalability analysis of inverse factorization using the Chunks and Tasks programming model

Improved Fast Recursive Algorithms for V-BLAST and G-STBC with Novel Efficient Matrix Inversion

An Improved Square-Root Algorithm for V-BLAST Based on Efficient Inverse Cholesky Factorization

Efficient Square-Root and Division Free Algorithms for Inverse LDLT Factorization and the Wide-Sense Givens Rotation with Application to V-BLAST

Implementing Communication-Optimal Parallel and Sequential QR Factorizations

$O(N)$ distributed direct factorization of structured dense matrices using runtime systems

Efficient algorithms for Tucker decomposition via approximate matrix multiplication

Communication-Optimal Parallel Algorithm for Strassen's Matrix Multiplication

QR factorization of ill-conditioned tall-and-skinny matrices on distributed-memory systems

On the Parallel I/O Optimality of Linear Algebra Kernels: Near-Optimal Matrix Factorizations

Stabilized Stepwise Orthogonal Matching Pursuit for Sparse Signal Approximation

On the Efficient Implementation of Sparse Bayesian Learning-Based STAP Algorithms

Parallel computation of echelon forms

Improved Algorithms for Alternating Matrix Space Isometry: from Theory to Practice

Greedy Orthogonal Pivoting Algorithm for Non-Negative Matrix Factorization.