Abstract:Traditional low-rank approximation is a powerful tool to compress the huge data matrices that arise in simulations of partial differential equations (PDE), but suffers from high computational cost and requires several passes over the PDE data. The compressed data may also lack interpretability thus making it difficult to identify feature patterns from the original data. To address these issues, we present an online randomized algorithm to compute the interpolative decomposition (ID) of large-scale data matrices {\em in situ}. Compared to previous randomized IDs that used the QR decomposition to determine the column basis, we adopt a streaming ridge leverage score-based column subset selection algorithm that dynamically selects proper basis columns from the data and thus avoids an extra pass over the data to compute the coefficient matrix of the ID. In particular, we adopt a single-pass error estimator based on the non-adaptive Hutch++ algorithm to provide real-time error approximation for determining the best coefficients. As a result, our approach only needs a single pass over the original data and thus is suitable for large and high-dimensional matrices stored outside of core memory or generated in PDE simulations. A strategy to improve the accuracy of the reconstructed data gradient, when desired, within the ID framework is also presented. We provide numerical experiments on turbulent channel flow and ignition simulations, and on the NSTX Gas Puff Image dataset, comparing our algorithm with the offline ID algorithm to demonstrate its utility in real-world applications.

Efficient MPI parallel interpolative decomposition

Fast Solution of Linear Systems with Many Right Hand Sides Using MPI Parallel Interpolative Decomposition

Fast Solution Of Linear Systems With Many Right Hand Sides Using Mpi Parallel Skeletonization

Online randomized interpolative decomposition with a posteriori error estimator for temporal PDE data reduction

A TIME DECOMPOSITION PARALLEL ALGORITHM FOR SOLVING TIME-DEPENDENT PROBLEMS

A Parallel Iterative Method for Solving Periodical Block-Tridiagonal Linear Equations.

Application of Interpolative Decomposition to FE-BI-MLFMA for Fast Computation of Monostatic Scattering from 3-D Complex Composite Objects

Deinsum: Practically I/O Optimal Multilinear Algebra

An implementation of MPI and hybrid OpenMP/MPI parallelization strategies for an implicit 3D DDG solver

An Efficient Matrix Equation Parallel Direct Solver for Higher-Order Method of Moments in Solution of Complex Electromagnetic Problems.

A Parallel Method for Isogeometric Analysis Using Computational Domain Decomposition

Adaptive Parallelizable Algorithms for Interpolative Decompositions via Partially Pivoted LU

Decomposition method for block-tridiagonal matrix systems

An efficient hybrid tridiagonal divide-and-conquer algorithm on distributed memory architectures

Iteration-merged Solver for Linear Banded Matrices Based on Domain Decomposition and MPI

Recursive sparse LU decomposition based on nested dissection and low rank approximations

A Fast Algorithm for Multiscale Electromagnetic Problems Using Interpolative Decomposition and Multilevel Fast Multipole Algorithm

Limited-memory common-directions method for large-scale optimization: convergence, parallelization, and distributed optimization

Wide Angular Sweeping of Dynamic Electromagnetic Responses from Large Targets by MPI Parallel Skeletonization

Parallel Domain Decomposition Methods with Mixed Order Discretization for Fully Implicit Solution of Tracer Transport Problems on the Cubed-Sphere.

Preconditioning Technique in the Interpolative Decomposition Multilevel Fast Multipole Algorithm