Abstract:Randomized algorithms for low-rank matrix approximation are investigated, with the emphasis on the fixed-precision problem and computational efficiency for handling large matrices. The algorithms are based on the so-called QB factorization, where Q is an orthonormal matrix. First, a mechanism for calculating the approximation error in the Frobenius norm is proposed, which enables efficient adaptive rank determination for a large and/or sparse matrix. It can be combined with any QB-form factorization algorithm in which B's rows are incrementally generated. Based on the blocked randQB algorithm by Martinsson and Voronin, this results in an algorithm called randQB_EI. Then, we further revise the algorithm to obtain a pass-efficient algorithm, randQB_FP, which is mathematically equivalent to the existing randQB algorithms and also suitable for the fixed-precision problem. Especially, randQB_FP can serve as a single-pass algorithm for calculating leading singular values, under a certain condition. With large and/or sparse test matrices, we have empirically validated the merits of the proposed techniques, which exhibit remarkable speedup and memory saving over the blocked randQB algorithm. We have also demonstrated that the single-pass algorithm derived by randQB_FP is much more accurate than an existing single-pass algorithm. And with data from a scenic image and an information retrieval application, we have shown the advantages of the proposed algorithms over the adaptive range finder algorithm for solving the fixed-precision problem.

An Efficient Randomized Low-Rank Matrix Factorization with Application to Robust PCA

A Fast Factorization-based Approach to Robust PCA

Fast Algorithms for Robust Principal Component Analysis with an Upper Bound on the Rank.

Compressed Randomized UTV Decompositions for Low-Rank Approximations and Big Data Applications

Study of Compressed Randomized UTV Decompositions for Low-Rank Matrix Approximations in Data Science

Robust principal component analysis: A factorization-based approach with linear complexity

Efficient Robust Principal Component Analysis Via Block Krylov Iteration and CUR Decomposition

Efficient Randomized Algorithms for the Fixed-Precision Low-Rank Matrix Approximation

RES-PCA: A Scalable Approach to Recovering Low-Rank Matrices

An algorithm for low-rank matrix factorization and its applications

Exactly Robust Kernel Principal Component Analysis

Robust factored principal component analysis for matrix-valued outlier accommodation and detection

Fast Randomized PCA for Sparse Data

RAP: Scalable RPCA for Low-rank Matrix Recovery

Adaptive Rank Estimate in Robust Principal Component Analysis

Reweighted Quasi Norm Regularized Low-Rank Factorization for Matrix Robust PCA

Nearly-optimal Robust Matrix Completion

Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices Via Convex Optimization.

Efficient algorithms for computing rank-revealing factorizations on a GPU

URV Factorization with Random Orthogonal System Mixing

Randomized algorithms for distributed computation of principal component analysis and singular value decomposition