Abstract:The randomized singular value decomposition proposed in [12] has certainly become one of the most well-established randomization-based algorithms in numerical linear algebra. The key ingredient of the entire procedure is the computation of a subspace which is close to the column space of the target matrix $\mathbf{A}$ up to a certain probabilistic confidence. In this paper we propose a modification to the standard randomized SVD procedure which leads, in general, to better approximations to $\text{Range}(\mathbf{A})$ at the same computational cost. To this end, we explicitly construct information from the row space of $\mathbf{A}$ enhancing the quality of our approximation. We also observe that very few pieces of information from $\text{Range}(\mathbf{A}^T)$ are indeed necessary. We thus design a variant of our algorithm equipped with a subsampling step which largely increases the efficiency of our procedure while attaining competitive accuracy records. Our findings are supported by both theoretical analysis and numerical results.

What problem does this paper attempt to address?

### Problems the paper attempts to solve The problem that this paper attempts to solve is how to improve the traditional Randomized Singular Value Decomposition (RSVD) algorithm to provide a better approximation effect while maintaining the same computational cost. Specifically, the author proposes two new algorithms: 1. **Row - aware Randomized Singular Value Decomposition (R - RSVD)**: - By explicitly constructing information from the row space of matrix $A$, rather than only extracting information from the column space, the approximation quality of $\text{Range}(A)$ is improved. - This algorithm can provide a better approximation effect than the standard RSVD without increasing the computational cost. 2. **Subsampled Row - aware Randomized Singular Value Decomposition (Rsub - RSVD)**: - On the basis of R - RSVD, a subsampling step is further introduced, which significantly reduces the computational cost while maintaining the precision comparable to RSVD. - By randomly selecting rows of $A$ to reduce the amount of computation, especially when dealing with large - scale data sets, this method can greatly improve efficiency. ### Main contributions - **R - RSVD**: - It provides a better approximation effect, especially in low - rank approximation. - By explicitly using row - space information, the accuracy of approximation is improved. - **Rsub - RSVD**: - Through subsampling techniques, the computational cost is significantly reduced. - While maintaining high precision, it is suitable for processing large - scale data sets. ### Theoretical analysis and numerical results - **Theoretical analysis**: - The author provides a detailed theoretical analysis and proves the error bounds of the new algorithms under the Frobenius norm and the spectral norm. - By introducing new random matrices and subsampling techniques, it is proved that these algorithms have good performance in probability. - **Numerical results**: - The effectiveness of the new algorithms is verified through multiple numerical experiments. - The experimental results show that R - RSVD and Rsub - RSVD can provide approximation effects superior to the standard RSVD in different application scenarios. ### Application scenarios - **CUR decomposition**: - Using R - RSVD and Rsub - RSVD for CUR decomposition shows their application in data - driven model order reduction. - **Löwner framework**: - Building a reduced - order model under the Löwner framework further verifies the practical value of the new algorithms. ### Conclusion By proposing R - RSVD and Rsub - RSVD, this paper successfully improves the traditional RSVD algorithm, not only enhancing the approximation effect but also significantly reducing the computational cost. These new algorithms perform well in multiple application scenarios and have important theoretical and practical significance.

Row-aware Randomized SVD with applications

Perturbation Analysis of Randomized SVD and its Applications to High-dimensional Statistics

Randomized algorithms for low-rank matrix approximation: Design, analysis, and applications

Bilateral Sampling Randomized Singular Value Decomposition

Efficient Bounds and Estimates for Canonical Angles in Randomized Subspace Approximations

Large-scale Nyström kernel matrix approximation using randomized SVD.

A randomized algorithm for the QR decomposition-based approximate SVD

Algorithm xxx: Faster Randomized SVD with Dynamic Shifts

A Randomized Algorithm for Approximating Truncated SVD

A Power Method for Computing Singular Value Decomposition

A Randomized Algorithm for Tensor Singular Value Decomposition using an Arbitrary Number of Passes

Randomized Algorithms for Solving Singular Value Decomposition Problems with Matlab Toolbox

Faster Matrix Completion Using Randomized SVD

Efficient GPU implementation of randomized SVD and its applications

Robust SVD Made Easy: A fast and reliable algorithm for large-scale data analysis

The Singular Value Decomposition, Applications and Beyond.

Pass-Efficient Randomized SVD with Boosted Accuracy

A Fast Randomized Algorithm for Computing an Approximate Null Space

Randomized algorithms for distributed computation of principal component analysis and singular value decomposition