Abstract:This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential equations and control problems. One often finds that $X$ admits good low-rank approximations, in particular when the right-hand side matrix $F$ has low rank. For $\ell \le 2$ terms, the solution of such equations is well studied and effective low-rank solvers have been proposed, including Alternating Direction Implicit (ADI) methods for Lyapunov and Sylvester equations. For $\ell > 2$, several existing methods try to approach $X$ through combining a classical iterative method, such as the conjugate gradient (CG) method, with low-rank truncation. In this work, we consider a more direct approach that approximates $X$ on manifolds of fixed-rank matrices through Riemannian CG. One particular challenge is the incorporation of effective preconditioners into such a first-order Riemannian optimization method. We propose several novel preconditioning strategies, including a change of metric in the ambient space, preconditioning the Riemannian gradient, and a variant of ADI on the tangent space. Combined with a strategy for adapting the rank of the approximation, the resulting method is demonstrated to be competitive for a number of examples representative for typical applications.

An Exponential Approach to Highly Ill-Conditioned Linear Systems

Note on Predictor-Corrector Process for Ill-Conditioned Linear System of Equations

An effective predictor–corrector process for large scale linear system of equations

A NUMERICAL METHOD OF STIFF PROBLEMS FOR ILL-CONDITIONED LINEAR SYSTEMS OF ALGEBRAIC EQUATIONS

Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Solving ill-conditioned linear algebraic systems using methods that improve conditioning

New Iterative Improvement of a Solution for an Ill-conditioned System of Linear Equations Based on a Linear Dynamic System

Extended version with the analysis of dynamic system for iterative refinement of solution

Error analysis for the predictor–corrector process relating to ill-conditioned linear system of equations

Computing the Hermitian Positive Definite Solutions of a Nonlinear Matrix Equation

An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Iterative Refinement of Solution with Biparameter for Solving Ill-Conditioned Systems of Linear Algebraic Equations

Computing Symmetric Positive Definite Solutions of Three Types of Nonlinear Matrix Equations

A rational conjugate gradient method for linear ill-conditioned problems

High-Performance Computation of the Exponential of a Large Sparse Matrix

Computing exponentials of essentially non-negative matrices entrywise to high relative accuracy.

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations

On the Positive Definite Solutions of a Nonlinear Matrix Equation

On the Hermitian positive definite solution and Newton's method for a nonlinear matrix equation

High order concentrated non-negative matrix-exponential functions

Computing the exponential of matrices