Abstract:We develop two new sets of stable, rank-adaptive Dynamically Orthogonal Runge-Kutta (DORK) schemes that capture the high-order curvature of the nonlinear low-rank manifold. The DORK schemes asymptotically approximate the truncated singular value decomposition at a greatly reduced cost while preserving mode continuity using newly derived retractions. We show that arbitrarily high-order optimal perturbative retractions can be obtained, and we prove that these new retractions are stable. In addition, we demonstrate that repeatedly applying retractions yields a gradient-descent algorithm on the low-rank manifold that converges superlinearly when approximating a low-rank matrix. When approximating a higher-rank matrix, iterations converge linearly to the best low-rank approximation. We then develop a rank-adaptive retraction that is robust to overapproximation. Building off of these retractions, we derive two rank-adaptive integration schemes that dynamically update the subspace upon which the system dynamics are projected within each time step: the stable, optimal Dynamically Orthogonal Runge-Kutta (so-DORK) and gradient-descent Dynamically Orthogonal Runge-Kutta (gd-DORK) schemes. These integration schemes are numerically evaluated and compared on an ill-conditioned matrix differential equation, an advection-diffusion partial differential equation, and a nonlinear, stochastic reaction-diffusion partial differential equation. Results show a reduced error accumulation rate with the new stable, optimal and gradient-descent integrators. In addition, we find that rank adaptation allows for highly accurate solutions while preserving computational efficiency.

Coordinate-Adaptive Integration of PDEs on Tensor Manifolds

Coordinate-adaptive integration of PDEs on tensor manifolds

Tensor rank reduction via coordinate flows

Collocation methods for nonlinear differential equations on low-rank manifolds

Sylvester-Preconditioned Adaptive-Rank Implicit Time Integrators for Advection-Diffusion Equations with Inhomogeneous Coefficients

Rank adaptive tensor recovery based model reduction for partial differential equations with high-dimensional random inputs

A rank-adaptive robust integrator for dynamical low-rank approximation

Time integration of rank-constrained Tucker tensors

Krylov-based Adaptive-Rank Implicit Time Integrators for Stiff Problems with Application to Nonlinear Fokker-Planck Kinetic Models

Solving High Dimensional Partial Differential Equations Using Tensor Type Discretization and Optimization Process

Cross Interpolation for Solving High-Dimensional Dynamical Systems on Low-Rank Tucker and Tensor Train Manifolds

Optimization on manifolds: A symplectic approach

Preconditioned low-rank Riemannian optimization for linear systems with tensor product structure

Stable rank-adaptive Dynamically Orthogonal Runge-Kutta schemes

Implicit low-rank Riemannian schemes for the time integration of stiff partial differential equations

High-order Adaptive Rank Integrators for Multi-scale Linear Kinetic Transport Equations in the Hierarchical Tucker Format

Tensor approximation of functional differential equations

A low-rank tensor method for PDE-constrained optimization with isogeometric analysis

Robust Implicit Adaptive Low Rank Time-Stepping Methods for Matrix Differential Equations

Improved ParaDiag via low-rank updates and interpolation

Dynamical low-rank tensor approximations to high-dimensional parabolic problems: existence and convergence of spatial discretizations