Abstract:This work is concerned with computing low-rank approximations of a matrix function $f(A)$ for a large symmetric positive semi-definite matrix $A$, a task that arises in, e.g., statistical learning and inverse problems. The application of popular randomized methods, such as the randomized singular value decomposition or the Nyström approximation, to $f(A)$ requires multiplying $f(A)$ with a few random vectors. A significant disadvantage of such an approach, matrix-vector products with $f(A)$ are considerably more expensive than matrix-vector products with $A$, even when carried out only approximately via, e.g., the Lanczos method. In this work, we present and analyze funNyström, a simple and inexpensive method that constructs a low-rank approximation of $f(A)$ directly from a Nyström approximation of $A$, completely bypassing the need for matrix-vector products with $f(A)$. It is sensible to use funNyström whenever $f$ is monotone and satisfies $f(0) = 0$. Under the stronger assumption that $f$ is operator monotone, which includes the matrix square root $A^{1/2}$ and the matrix logarithm $\log(I+A)$, we derive probabilistic bounds for the error in the Frobenius, nuclear, and operator norms. These bounds confirm the numerical observation that funNyström tends to return an approximation that compares well with the best low-rank approximation of $f(A)$. Furthermore, compared to existing methods, funNyström requires significantly fewer matrix-vector products with $A$ to obtain a low-rank approximation of $f(A)$, without sacrificing accuracy or reliability. Our method is also of interest when estimating quantities associated with $f(A)$, such as the trace or the diagonal entries of $f(A)$. In particular, we propose and analyze funNyström++, a combination of funNyström with the recently developed Hutch++ method for trace estimation.

Randomized low-rank Runge-Kutta methods

Randomised methods for dynamical low-rank approximation

A rank-adaptive robust integrator for dynamical low-rank approximation

Robust Implicit Adaptive Low Rank Time-Stepping Methods for Matrix Differential Equations

Randomized Iterative Methods for Linear Systems

Stable rank-adaptive Dynamically Orthogonal Runge-Kutta schemes

CUR for Implicit Time Integration of Random Partial Differential Equations on Low-Rank Matrix Manifolds

Projected exponential methods for stiff dynamical low-rank approximation problems

Randomized low-rank approximation of parameter-dependent matrices

Randomized Runge-Kutta-Nyström Methods for Unadjusted Hamiltonian and Kinetic Langevin Monte Carlo

A parallel rank-adaptive integrator for dynamical low-rank approximation

Low rank approximation method for perturbed linear systems with applications to elliptic type stochastic PDEs

A general error analysis for randomized low-rank approximation with application to data assimilation

Convergence and stability of randomized implicit two-stage Runge-Kutta schemes

An alternating low-rank projection approach for partial differential equations with random inputs

Randomized low-rank approximation of monotone matrix functions

A stable multiplicative dynamical low-rank discretization for the linear Boltzmann-BGK equation

A Quadratically Convergent Algorithm for Structured Low-Rank Approximation

An unconventional robust integrator for dynamical low-rank approximation

Adaptive rational Krylov methods for exponential Runge--Kutta integrators

A Unifying Theory for Runge--Kutta-like Time Integrators: Convergence and Stability