Abstract:This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential equations and control problems. One often finds that $X$ admits good low-rank approximations, in particular when the right-hand side matrix $F$ has low rank. For $\ell \le 2$ terms, the solution of such equations is well studied and effective low-rank solvers have been proposed, including Alternating Direction Implicit (ADI) methods for Lyapunov and Sylvester equations. For $\ell > 2$, several existing methods try to approach $X$ through combining a classical iterative method, such as the conjugate gradient (CG) method, with low-rank truncation. In this work, we consider a more direct approach that approximates $X$ on manifolds of fixed-rank matrices through Riemannian CG. One particular challenge is the incorporation of effective preconditioners into such a first-order Riemannian optimization method. We propose several novel preconditioning strategies, including a change of metric in the ambient space, preconditioning the Riemannian gradient, and a variant of ADI on the tangent space. Combined with a strategy for adapting the rank of the approximation, the resulting method is demonstrated to be competitive for a number of examples representative for typical applications.

Off-diagonal Low-Rank Preconditioner for Difficult PageRank Problems

Weak dangling block reordering and multi-step block compression for efficiently computing and updating PageRank solutions

An Efficient Elimination Strategy for Solving Pagerank Problems

A Preconditioned and Extrapolation-Accelerated GMRES Method for PageRank

FOM Accelerated by an Extrapolation Method for Solving PageRank Problems.

Enhanced preprocessed multi-step splitting iterations for computing PageRank

Accelerating the Arnoldi-Type Algorithm for the PageRank Problem and the ProteinRank Problem

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations

An Improved Approach to the PageRank Problems

Shifted power-GMRES method accelerated by extrapolation for solving PageRank with multiple damping factors

A Preconditioner based on Non-uniform Row Sampling for Linear Least Squares Problems

Matrix Nearness Problems with Off-Block-Diagonal Rank Constraints

A Preconditioned Riemannian Gradient Descent Algorithm for Low-Rank Matrix Recovery

On computing PageRank via lumping the Google matrix

Scalable Approximate Optimal Diagonal Preconditioning

Two-level Nyström-Schur preconditioner for sparse symmetric positive definite matrices

An Adaptive Reordered Method for Computing PageRank

A Limited-Memory Block Bi-Diagonal Toeplitz Preconditioner for Block Lower Triangular Toeplitz System from Time-Space Fractional Diffusion Equation

Restrictive Preconditioners for Conjugate Gradient Methods for Symmetric Positive Definite Linear Systems