Abstract:Traditional low-rank approximation is a powerful tool to compress the huge data matrices that arise in simulations of partial differential equations (PDE), but suffers from high computational cost and requires several passes over the PDE data. The compressed data may also lack interpretability thus making it difficult to identify feature patterns from the original data. To address these issues, we present an online randomized algorithm to compute the interpolative decomposition (ID) of large-scale data matrices {\em in situ}. Compared to previous randomized IDs that used the QR decomposition to determine the column basis, we adopt a streaming ridge leverage score-based column subset selection algorithm that dynamically selects proper basis columns from the data and thus avoids an extra pass over the data to compute the coefficient matrix of the ID. In particular, we adopt a single-pass error estimator based on the non-adaptive Hutch++ algorithm to provide real-time error approximation for determining the best coefficients. As a result, our approach only needs a single pass over the original data and thus is suitable for large and high-dimensional matrices stored outside of core memory or generated in PDE simulations. A strategy to improve the accuracy of the reconstructed data gradient, when desired, within the ID framework is also presented. We provide numerical experiments on turbulent channel flow and ignition simulations, and on the NSTX Gas Puff Image dataset, comparing our algorithm with the offline ID algorithm to demonstrate its utility in real-world applications.

Randomized Alternating Least Squares for Canonical Tensor Decompositions: Application to a PDE with Random Data

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

Randomized algorithms for total least squares problems.

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

Optimal Randomized First-Order Methods for Least-Squares Problems

An Efficient Randomized Fixed-Precision Algorithm for Tensor Singular Value Decomposition

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

An alternating low-rank projection approach for partial differential equations with random inputs

Online randomized interpolative decomposition with a posteriori error estimator for temporal PDE data reduction

Randomized sketched TT-GMRES for linear systems with tensor structure

Randomized Algorithms for the Approximations of Tucker and the Tensor Train Decompositions.

Efficient Alternating Least Squares Algorithms for Truncated HOSVD of Higher-Order Tensors.

Some Convergence Results on the Regularized Alternating Least-Squares Method for Tensor Decomposition

Randomized Kaczmarz Algorithm for Inconsistent Linear Systems: An Exact MSE Analysis

Towards Practical Large-scale Randomized Iterative Least Squares Solvers through Uncertainty Quantification

High-precision randomized iterative methods for the random feature method

Randomized Kaczmarz for tensor linear systems

Rank adaptive tensor recovery based model reduction for partial differential equations with high-dimensional random inputs

A random sampling algorithm for fully-connected tensor network decomposition with applications

A block-randomized stochastic method with importance sampling for CP tensor decomposition

A general error analysis for randomized low-rank approximation with application to data assimilation