Abstract:Randomized algorithms for low-rank matrix approximation are investigated, with the emphasis on the fixed-precision problem and computational efficiency for handling large matrices. The algorithms are based on the so-called QB factorization, where Q is an orthonormal matrix. First, a mechanism for calculating the approximation error in the Frobenius norm is proposed, which enables efficient adaptive rank determination for a large and/or sparse matrix. It can be combined with any QB-form factorization algorithm in which B's rows are incrementally generated. Based on the blocked randQB algorithm by Martinsson and Voronin, this results in an algorithm called randQB_EI. Then, we further revise the algorithm to obtain a pass-efficient algorithm, randQB_FP, which is mathematically equivalent to the existing randQB algorithms and also suitable for the fixed-precision problem. Especially, randQB_FP can serve as a single-pass algorithm for calculating leading singular values, under a certain condition. With large and/or sparse test matrices, we have empirically validated the merits of the proposed techniques, which exhibit remarkable speedup and memory saving over the blocked randQB algorithm. We have also demonstrated that the single-pass algorithm derived by randQB_FP is much more accurate than an existing single-pass algorithm. And with data from a scenic image and an information retrieval application, we have shown the advantages of the proposed algorithms over the adaptive range finder algorithm for solving the fixed-precision problem.

Randomized algorithms for total least squares problems.

Perturbation Analysis and Randomized Algorithms for Large-Scale Total Least Squares Problems

Regularization Total Least Squares and Randomized Algorithms

Optimal Randomized First-Order Methods for Least-Squares Problems

Towards Practical Large-scale Randomized Iterative Least Squares Solvers through Uncertainty Quantification

Randomized Alternating Least Squares for Canonical Tensor Decompositions: Application to a PDE with Random Data

Assessing stochastic algorithms for large scale nonlinear least squares problems using extremal probabilities of linear combinations of gamma random variables

An algorithm for solving rank-deficient scaled total least square problems

Randomized Extended Kaczmarz for Solving Least-Squares

Randomised subspace methods for non-convex optimization, with applications to nonlinear least-squares

Efficient Randomized Algorithms for the Fixed-Precision Low-Rank Matrix Approximation

High-precision randomized iterative methods for the random feature method

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

Randomized algorithms for low-rank matrix approximation: Design, analysis, and applications

Randomized symmetric Gauss-Seidel method for solving linear least squares problems

An Algorithm for Solving Scaled Total Least Squares Problems.

On adaptive stochastic extended iterative methods for solving least squares

A general error analysis for randomized low-rank approximation with application to data assimilation

Randomized Algorithms for the Approximations of Tucker and the Tensor Train Decompositions.

Randomized Matrix Approximation to Enhance Regularized Projection Schemes in Inverse Problems

Fast and forward stable randomized algorithms for linear least-squares problems