Abstract:This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential equations and control problems. One often finds that $X$ admits good low-rank approximations, in particular when the right-hand side matrix $F$ has low rank. For $\ell \le 2$ terms, the solution of such equations is well studied and effective low-rank solvers have been proposed, including Alternating Direction Implicit (ADI) methods for Lyapunov and Sylvester equations. For $\ell > 2$, several existing methods try to approach $X$ through combining a classical iterative method, such as the conjugate gradient (CG) method, with low-rank truncation. In this work, we consider a more direct approach that approximates $X$ on manifolds of fixed-rank matrices through Riemannian CG. One particular challenge is the incorporation of effective preconditioners into such a first-order Riemannian optimization method. We propose several novel preconditioning strategies, including a change of metric in the ambient space, preconditioning the Riemannian gradient, and a variant of ADI on the tangent space. Combined with a strategy for adapting the rank of the approximation, the resulting method is demonstrated to be competitive for a number of examples representative for typical applications.

Jacobi-Davidson method on low-rank matrix manifolds

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations

A modification of the Jacobi-Davidson method

Riemannian Preconditioned Coordinate Descent for Low Multilinear Rank Approximation

A Riemannian rank-adaptive method for low-rank matrix completion

Riemannian preconditioned coordinate descent for low multi-linear rank approximation

A Refined Jacobi-Davidson Method and Its Correction Equation

A Sherman--Morrison--Woodbury approach to solving least squares problems with low-rank updates

An increasing rank Riemannian method for generalized Lyapunov equations

Euclidean Representation of Low-Rank Matrices and Its Geometric Properties

Preconditioned low-rank Riemannian optimization for linear systems with tensor product structure

A Convergence Analysis of the Inexact Rayleigh Quotient Iteration and Simplified Jacobi-Davidson Method for the Large Hermitian Matrix Eigenproblem

A Quadratically Convergent Algorithm for Structured Low-Rank Approximation

On low-rank approximability of solutions to high-dimensional operator equations and eigenvalue problems

Low-Rank Methods for Solving Discrete-Time Projected Lyapunov Equations

A Sorted Partial Jacobi Method and Its Convergence Analysis

Low-Rank Matrix Approximation with Manifold Regularization.

Collocation methods for nonlinear differential equations on low-rank manifolds

Riemannian coordinate descent algorithms on matrix manifolds

A Refined Jacobi-Davidson Method for the Quadratic Eigenvalue Problem

A Riemannian optimization method on the indefinite Stiefel manifold