Abstract:This paper describes efficient algorithms for computing rank-revealing factorizations of matrices that are too large to fit in RAM, and must instead be stored on slow external memory devices such as solid-state or spinning disk hard drives (out-of-core or out-of-memory). Traditional algorithms for computing rank revealing factorizations, such as the column pivoted QR factorization, or techniques for computing a full singular value decomposition of a matrix, are very communication intensive. They are naturally expressed as a sequence of matrix-vector operations, which become prohibitively expensive when data is not available in main memory. Randomization allows these methods to be reformulated so that large contiguous blocks of the matrix can be processed in bulk. The paper describes two distinct methods. The first is a blocked version of column pivoted Householder QR, organized as a "left-looking" method to minimize the number of write operations (which are more expensive than read operations on a spinning disk drive). The second method results in a so called UTV factorization which expresses a matrix $A$ as $A = U T V^*$ where $U$ and $V$ are unitary, and $T$ is triangular. This method is organized as an algorithm-by-blocks, in which floating point operations overlap read and write operations. The second method incorporates power iterations, and is exceptionally good at revealing the numerical rank; it can often be used as a substitute for a full singular value decomposition. Numerical experiments demonstrate that the new algorithms are almost as fast when processing data stored on a hard drive as traditional algorithms are for data stored in main memory. To be precise, the computational time for fully factorizing an $n\times n$ matrix scales as $cn^{3}$, with a scaling constant $c$ that is only marginally larger when the matrix is stored out of core.

QR Factorization for Row or Column Symmetric Matrix

Exact QR factorizations of rectangular matrices

Fast Moving Window Algorithm for QR and Cholesky Decompositions

Implementing Communication-Optimal Parallel and Sequential QR Factorizations

Communication-optimal parallel and sequential QR and LU factorizations: theory and practice

Computing rank-revealing factorizations of matrices stored out-of-core

On rank‐revealing QR factorizations of quaternion matrices

Perturbation Analysis for Qr Factorization of Unitary-Symmetric Matrix

Parallel QR Factorization of Block Low-rank Matrices

Parallel Tiled QR Factorization for Multicore Architectures

QR factorization of ill-conditioned tall-and-skinny matrices on distributed-memory systems

Q-less QR Decomposition in Inner Product Spaces

Low-Rank Matrix Approximations with Flip-Flop Spectrum-Revealing QR Factorization

A 3D Parallel Algorithm for QR Decomposition

MAXIMUM RANK DECOMPOSITION AND ALGORITHM FOR ROW OR COLUMN SYMMETRIC MATRIX

A randomized algorithm for the QR decomposition-based approximate SVD

Computing Low-Rank Approximation of a Dense Matrix on Multicore CPUs with a GPU and Its Application to Solving a Hierarchically Semiseparable Linear System of Equations

A Fast Matrix Completion Method Based on Matrix Bifactorization and QR Decomposition

The Loewner-Neville Factorization Of Generalized Matrices With Consecutive-Column And -Row Properties

Efficient Noninteractive Outsourcing of Large-Scale QR and LU Factorizations

Fast and Low Memory Cost Matrix Factorization: Algorithm, Analysis, and Case Study.