Abstract:Randomized algorithms for low-rank matrix approximation are investigated, with the emphasis on the fixed-precision problem and computational efficiency for handling large matrices. The algorithms are based on the so-called QB factorization, where Q is an orthonormal matrix. First, a mechanism for calculating the approximation error in the Frobenius norm is proposed, which enables efficient adaptive rank determination for a large and/or sparse matrix. It can be combined with any QB-form factorization algorithm in which B's rows are incrementally generated. Based on the blocked randQB algorithm by Martinsson and Voronin, this results in an algorithm called randQB_EI. Then, we further revise the algorithm to obtain a pass-efficient algorithm, randQB_FP, which is mathematically equivalent to the existing randQB algorithms and also suitable for the fixed-precision problem. Especially, randQB_FP can serve as a single-pass algorithm for calculating leading singular values, under a certain condition. With large and/or sparse test matrices, we have empirically validated the merits of the proposed techniques, which exhibit remarkable speedup and memory saving over the blocked randQB algorithm. We have also demonstrated that the single-pass algorithm derived by randQB_FP is much more accurate than an existing single-pass algorithm. And with data from a scenic image and an information retrieval application, we have shown the advantages of the proposed algorithms over the adaptive range finder algorithm for solving the fixed-precision problem.

On Approximation Algorithm for Orthogonal Low-Rank Tensor Approximation

On The Tensor Svd And The Optimal Low Rank Orthogonal Approximation Of Tensors

On low-rank approximability of solutions to high-dimensional operator equations and eigenvalue problems

Efficient Orthogonal Decomposition with Automatic Basis Extraction for Low-Rank Matrix Approximation

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors

Low-rank approximate inverse for preconditioning tensor-structured linear systems

A general error analysis for randomized low-rank approximation with application to data assimilation

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

Approximation Algorithms for Orthogonal Non-negative Matrix Factorization

The bounds for the best rank-1 approximation ratio of a finite dimensional tensor space

Approximating Optimal Transport via Low-rank and Sparse Factorization

Learning-Based Low-Rank Approximations

Symmetric Rank-1 Approximation of Symmetric High-Order Tensors.

Efficient Randomized Algorithms for the Fixed-Precision Low-Rank Matrix Approximation

RA-HOOI: Rank-adaptive higher-order orthogonal iteration for the fixed-accuracy low multilinear-rank approximation of tensors

Approximate Solutions of Linear Systems at a Universal Rate

Rank Properties and Computational Methods for Orthogonal Tensor Decompositions

A Randomized Block Krylov Method for Tensor Train Approximation

Entrywise tensor-train approximation of large tensors via random embeddings

A tensor approximation method based on ideal minimal residual formulations for the solution of high-dimensional problems

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors