Abstract:Randomized algorithms for low-rank matrix approximation are investigated, with the emphasis on the fixed-precision problem and computational efficiency for handling large matrices. The algorithms are based on the so-called QB factorization, where Q is an orthonormal matrix. First, a mechanism for calculating the approximation error in the Frobenius norm is proposed, which enables efficient adaptive rank determination for a large and/or sparse matrix. It can be combined with any QB-form factorization algorithm in which B's rows are incrementally generated. Based on the blocked randQB algorithm by Martinsson and Voronin, this results in an algorithm called randQB_EI. Then, we further revise the algorithm to obtain a pass-efficient algorithm, randQB_FP, which is mathematically equivalent to the existing randQB algorithms and also suitable for the fixed-precision problem. Especially, randQB_FP can serve as a single-pass algorithm for calculating leading singular values, under a certain condition. With large and/or sparse test matrices, we have empirically validated the merits of the proposed techniques, which exhibit remarkable speedup and memory saving over the blocked randQB algorithm. We have also demonstrated that the single-pass algorithm derived by randQB_FP is much more accurate than an existing single-pass algorithm. And with data from a scenic image and an information retrieval application, we have shown the advantages of the proposed algorithms over the adaptive range finder algorithm for solving the fixed-precision problem.

An Efficient Randomized Algorithm for Computing the Approximate Tucker Decomposition

Efficient algorithms for Tucker decomposition via approximate matrix multiplication

Randomized Algorithms for the Approximations of Tucker and the Tensor Train Decompositions.

Parallel Randomized Tucker Decomposition Algorithms

Towards Efficient and Accurate Approximation: Tensor Decomposition Based on Randomized Block Krylov Iteration

A randomized algorithm for the QR decomposition-based approximate SVD

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

An Efficient Algorithm for Computing the Approximate T-Urv and Its Applications

The Computation of Low Multilinear Rank Approximations of Tensors Via Power Scheme and Random Projection

Low-Rank Tucker Approximation of a Tensor from Streaming Data

Randomized Algorithms for the Computation of Multilinear Rank-$$(\Mu _1,\mu _2,\mu _3)$$ Approximations

Efficient Randomized Algorithms for the Fixed-Precision Low-Rank Matrix Approximation

Randomized algorithms for computing the tensor train approximation and their applications

Efficient randomized tensor-based algorithms for function approximation and low-rank kernel interactions

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

Tensor LU and QR Decompositions and Their Randomized Algorithms

A Randomized Block Krylov Method for Tensor Train Approximation

A Randomized Algorithm for Approximating Truncated SVD

Randomized Quaternion UTV Decomposition and Randomized Quaternion Tensor UTV Decomposition

Efficient Algorithms for Low Tubal Rank Tensor Approximation with Applications to Image Compression, Super-Resolution and Deep Learning

Randomized Algorithms for Computation of Tucker Decomposition and Higher Order SVD (HOSVD)