Abstract:Randomized algorithms for low-rank matrix approximation are investigated, with the emphasis on the fixed-precision problem and computational efficiency for handling large matrices. The algorithms are based on the so-called QB factorization, where Q is an orthonormal matrix. First, a mechanism for calculating the approximation error in the Frobenius norm is proposed, which enables efficient adaptive rank determination for a large and/or sparse matrix. It can be combined with any QB-form factorization algorithm in which B's rows are incrementally generated. Based on the blocked randQB algorithm by Martinsson and Voronin, this results in an algorithm called randQB_EI. Then, we further revise the algorithm to obtain a pass-efficient algorithm, randQB_FP, which is mathematically equivalent to the existing randQB algorithms and also suitable for the fixed-precision problem. Especially, randQB_FP can serve as a single-pass algorithm for calculating leading singular values, under a certain condition. With large and/or sparse test matrices, we have empirically validated the merits of the proposed techniques, which exhibit remarkable speedup and memory saving over the blocked randQB algorithm. We have also demonstrated that the single-pass algorithm derived by randQB_FP is much more accurate than an existing single-pass algorithm. And with data from a scenic image and an information retrieval application, we have shown the advantages of the proposed algorithms over the adaptive range finder algorithm for solving the fixed-precision problem.

QRP Variation of Cross--Approximation Iterations for Low Rank Approximation

More on low rank approximation of a matrix

CUR Low Rank Approximation of a Matrix at Sublinear Cost

Efficient Randomized Algorithms for the Fixed-Precision Low-Rank Matrix Approximation

Accurate Low Rank Approximation at a Low Computational Cost

Projection-Based QLP Algorithm for Efficiently Computing Low-Rank Approximation of Matrices.

Low-Rank Matrix Approximations with Flip-Flop Spectrum-Revealing QR Factorization

The Application of ACA and SVD Algorithms in the Matrix Low-Rank Approximation

An Efficient Gauss--Newton Algorithm for Symmetric Low-Rank Product Matrix Approximations

Krylov Methods are (nearly) Optimal for Low-Rank Approximation

Computing Low-Rank Approximation of a Dense Matrix on Multicore CPUs with a GPU and Its Application to Solving a Hierarchically Semiseparable Linear System of Equations

Partly Approximate Iteration Technique For Accelerating Cg-Mlfma Solution

Nearly Optimal Approximation of Matrix Functions by the Lanczos Method

Fast Nested Cross Approximation Algorithm for Solving Large-Scale Electromagnetic Problems

Fast Convex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix

Fast Algorithms for Recovering a Corrupted Low-Rank Matrix

Fast Optimization Algorithm on Riemannian Manifolds and Its Application in Low-Rank Learning.

Fast Convex Optimization Algorithms for the Recovery of a Corrupted Low-Rank Matrix

A Multilevel Low-Rank Newton Method with Super-linear Convergence Rate and its Application to Non-convex Problems

Fast $(1+\varepsilon)$-Approximation Algorithms for Binary Matrix Factorization

Low-Rank Approximations with Sparse Factors I: Basic Algorithms and Error Analysis