Abstract:We develop two new sets of stable, rank-adaptive Dynamically Orthogonal Runge-Kutta (DORK) schemes that capture the high-order curvature of the nonlinear low-rank manifold. The DORK schemes asymptotically approximate the truncated singular value decomposition at a greatly reduced cost while preserving mode continuity using newly derived retractions. We show that arbitrarily high-order optimal perturbative retractions can be obtained, and we prove that these new retractions are stable. In addition, we demonstrate that repeatedly applying retractions yields a gradient-descent algorithm on the low-rank manifold that converges superlinearly when approximating a low-rank matrix. When approximating a higher-rank matrix, iterations converge linearly to the best low-rank approximation. We then develop a rank-adaptive retraction that is robust to overapproximation. Building off of these retractions, we derive two rank-adaptive integration schemes that dynamically update the subspace upon which the system dynamics are projected within each time step: the stable, optimal Dynamically Orthogonal Runge-Kutta (so-DORK) and gradient-descent Dynamically Orthogonal Runge-Kutta (gd-DORK) schemes. These integration schemes are numerically evaluated and compared on an ill-conditioned matrix differential equation, an advection-diffusion partial differential equation, and a nonlinear, stochastic reaction-diffusion partial differential equation. Results show a reduced error accumulation rate with the new stable, optimal and gradient-descent integrators. In addition, we find that rank adaptation allows for highly accurate solutions while preserving computational efficiency.

Randomised methods for dynamical low-rank approximation

Randomized low-rank Runge-Kutta methods

Randomized low-rank approximation of parameter-dependent matrices

Robust Implicit Adaptive Low Rank Time-Stepping Methods for Matrix Differential Equations

Dynamical Low-Rank Approximation for Stochastic Differential Equations

Low-rank plus diagonal approximations for Riccati-like matrix differential equations

Projected exponential methods for stiff dynamical low-rank approximation problems

Randomized Dynamic Mode Decomposition

CUR for Implicit Time Integration of Random Partial Differential Equations on Low-Rank Matrix Manifolds

Asymptotic-Preserving and Energy Stable Dynamical Low-Rank Approximation

A stable multiplicative dynamical low-rank discretization for the linear Boltzmann-BGK equation

Stable rank-adaptive Dynamically Orthogonal Runge-Kutta schemes

State-Of-The-Art Algorithms For Low-Rank Dynamic Mode Decomposition

Fast Randomized Numerical Rank Estimation for Numerically Low-Rank Matrices

On the Unreasonable Effectiveness of Single Vector Krylov Methods for Low-Rank Approximation

Randomized algorithms for low-rank matrix approximation: Design, analysis, and applications

Interpolatory dynamical low-rank approximation for the 3+3d Boltzmann-BGK equation

A Random Algorithm for Low-Rank Decomposition of Large-Scale Matrices with Missing Entries

Randomized low‐rank approximation methods for projection‐based model order reduction of large nonlinear dynamical problems

Optimal Low-Rank Dynamic Mode Decomposition