Abstract:For many applications involving a sequence of linear systems with slowly changing system matrices, subspace recycling, which exploits relationships among systems and reuses search space information, can achieve huge gains in iterations across the total number of linear system solves in the sequence. However, for general (i.e., non-identity) shifted systems with the shift value varying over a wide range, the properties of the linear systems vary widely as well, which makes recycling less effective. If such a sequence of systems is embedded in a nonlinear iteration, the problem is compounded, and special approaches are needed to use recycling effectively. In this paper, we develop new, more efficient, Krylov subspace recycling approaches for large-scale image reconstruction and restoration techniques that employ a nonlinear iteration to compute a suitable regularization matrix. For each new regularization matrix, we need to solve regularized linear systems, ${\bf A} + \gamma_\ell {\bf E}_k$, for a sequence of regularization parameters, $\gamma_\ell$, to find the optimally regularized solution that, in turn, will be used to update the regularization matrix. In this paper, we analyze system and solution characteristics to choose appropriate techniques to solve each system rapidly. Specifically, we use an inner-outer recycling approach with a larger, principal recycle space for each nonlinear step and smaller recycle spaces for each shift. We propose an efficient way to obtain good initial guesses from the principle recycle space and smaller shift-specific recycle spaces that lead to fast convergence. Our method is substantially reduces the total number of matrix-vector products that would arise in a naive approach. Our approach is more generally applicable to sequences of shifted systems where the matrices in the sum are positive semi-definite.

Recycling BiCG for Families of Shifted Linear Systems

Recycling BiCGSTAB with an Application to Parametric Model Order Reduction

Subspace Recycling for Sequences of Shifted Systems with Applications in Image Recovery

BiCR-type Methods for Families of Shifted Linear Systems

QMRCGstab Algorithm for Families of Shifted Linear Systems

Krylov Subspace Recycling for Evolving Structures

A SQMRCGstab Algorithm for Families of Shifted Linear Systems

Global GMRES with Deflated Restarting for Families of Shifted Linear Systems

Iterative Solution of Multi-Shifted Linear Systems with Multiple Right-Hand Sides.

Krylov-Subspace Recycling via the POD-Augmented Conjugate-Gradient Method

Gradient-based iterative approach for solving constrained systems of linear matrix equations

Recycling Krylov subspaces for CFD applications and a new hybrid recycling solver

A survey of subspace recycling iterative methods

Generalized Krylov Recycling Methods For Solution Of Multiple Related Linear Equation Systems In Electromagnetic Analysis

Solving Shifted Linear Systems with Restarted GMRES Augmented with Error Approximations.

On Krylov subspace methods for skew-symmetric and shifted skew-symmetric linear systems

Conjugate Residual Squared Method and Its Improvement for Non-Symmetric Linear Systems.

Efficient gradient-based methods for bilevel learning via recycling Krylov subspaces

The SCBiCG class of algorithms for complex symmetric linear systems with applications in several electromagnetic model problems

The S-Bicr Algorithm to Solve Nonsymmetric Linear Systems

Memory-efficient recycling of large Krylov-subspaces for sequences of Hermitian linear systems