Abstract:This paper presents two new augmented flexible (AF)-Krylov subspace methods, AF-GMRES and AF-LSQR, to compute solutions of large-scale linear discrete ill-posed problems that can be modeled as the sum of two independent random variables, exhibiting smooth and sparse stochastic characteristics respectively. Following a Bayesian modelling approach, this corresponds to adding a covariance-weighted quadratic term and a sparsity enforcing $\ell_1$ term in the original least-squares minimization scheme. To handle the $\ell_1$ regularization term, the proposed approach constructs a sequence approximating quadratic problems that are partially solved using augmented flexible Krylov-Tikhonov methods. Compared to other traditional methods used to solve this minimization problem, such as those based on iteratively reweighted norm schemes, the new algorithms build a single (augmented, flexible) approximation (Krylov) subspace that encodes information about the different regularization terms through adaptable "preconditioning". The solution space is then expanded as soon as a new problem within the sequence is defined. This also allows for the regularization parameters to be chosen on-the-fly at each iteration. Compared to most recent work on generalized flexible Krylov methods, our methods offer theoretical assurance of convergence and a more stable numerical performance. The efficiency of the new methods is shown through a variety of experiments, including a synthetic image deblurring problem, a synthetic atmospheric transport problem, and fluorescence molecular tomography reconstructions using both synthetic and real-world experimental data.

Structural properties of Krylov subspaces, Krylov solvability, and applications to unbounded self-adjoint operators

Open problems and perspectives on solving Friedrichs systems by Krylov approximation

A note on the Krylov solvability of compact normal operators on Hilbert space

Deterministic and Stochastic Cauchy problems for a class of weakly hyperbolic operators on R^n

The solvability of inhomogeneous boundary-value problems in Sobolev spaces

On Lagrange multipliers of the KKT system in Hilbert spaces

On low-rank approximability of solutions to high-dimensional operator equations and eigenvalue problems

Towards verifications of Krylov complexity

Krylov methods for low-rank commuting generalized Sylvester equations

On Spectral Properties of some Class of Non-selfadjoint Operators

Augmented Flexible Krylov Subspace methods with applications to Bayesian inverse problems

Around the Van Daele--Schmüdgen theorem

Estimating the numerical range with a Krylov subspace

Interior point solutions of variational problems and global inverse function theorems

Direct and inverse problems for the matrix Sturm-Liouville operator with the general self-adjoint boundary conditions

Randomized Nyström approximation of non-negative self-adjoint operators

A hybrid Krasnosel'skiĭ-Schauder fixed point theorem for systems

On The Solvability Complexity Index for Unbounded Selfadjoint Operators and Schrödinger Operators

Subspace embedding with random Khatri-Rao products and its application to eigensolvers