Abstract:This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential equations and control problems. One often finds that $X$ admits good low-rank approximations, in particular when the right-hand side matrix $F$ has low rank. For $\ell \le 2$ terms, the solution of such equations is well studied and effective low-rank solvers have been proposed, including Alternating Direction Implicit (ADI) methods for Lyapunov and Sylvester equations. For $\ell > 2$, several existing methods try to approach $X$ through combining a classical iterative method, such as the conjugate gradient (CG) method, with low-rank truncation. In this work, we consider a more direct approach that approximates $X$ on manifolds of fixed-rank matrices through Riemannian CG. One particular challenge is the incorporation of effective preconditioners into such a first-order Riemannian optimization method. We propose several novel preconditioning strategies, including a change of metric in the ambient space, preconditioning the Riemannian gradient, and a variant of ADI on the tangent space. Combined with a strategy for adapting the rank of the approximation, the resulting method is demonstrated to be competitive for a number of examples representative for typical applications.

An ABS Algorithm for Solving Singular Nonlinear Systems with Rank One Defect

THE SOLVABILITY FOR NONLINEAR SINGULARLY PERTURBED DIFFERENTIAL SYSTEM

Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

A two-step algorithm for solving singular linear systems with index one.

Singular algebraic equations with empirical data

Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Randomized methods for rank-deficient linear systems

ABS Algorithms for Linear Systems and Optimization

A Smoothing-Type Algorithm for Solving System of Inequalities

On an Iterative Method for Solving the Least Squares Problem of Rank-Deficient Systems

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations

Two-step Newton's method for deflation-one singular zeros of analytic systems

Convergence Properties Of Krylov Subspace Methods For Singular Linear Systems With Arbitrary Index

An algorithm for solving rank-deficient scaled total least square problems

Solving systems of linear equations via gradient systems with discontinuous righthand sides: application to LS-SVM

Convergence and Quotient Convergence of Iterative Methods for Solving Singular Linear Equations with Index One

Two Modified Single-Parameter Scaling Broyden–Fletcher–Goldfarb–Shanno Algorithms for Solving Nonlinear System of Symmetric Equations

Solving Systems of Phaseless Equations Via Riemannian Optimization with Optimal Sampling Complexity

On the Positive Definite Solutions of a Nonlinear Matrix Equation

Abs Algorithms for Linear Equations and Abspack

A New Algorithm Applied in Control-Relevant Discretization of Nonlinear Systems