Abstract:This paper presents two new augmented flexible (AF)-Krylov subspace methods, AF-GMRES and AF-LSQR, to compute solutions of large-scale linear discrete ill-posed problems that can be modeled as the sum of two independent random variables, exhibiting smooth and sparse stochastic characteristics respectively. Following a Bayesian modelling approach, this corresponds to adding a covariance-weighted quadratic term and a sparsity enforcing l1 term in the original least-squares minimization scheme. To handle the l1 regularization term, the proposed approach constructs a sequence approximating quadratic problems that are partially solved using augmented flexible Krylov–Tikhonov methods. Compared to other traditional methods used to solve this minimization problem, such as those based on iteratively reweighted norm schemes, the new algorithms build a single (augmented, flexible) approximation (Krylov) subspace that encodes information about the different regularization terms through adaptable "preconditioning". The solution space is then expanded as soon as a new problem within the sequence is defined. This also allows for the regularization parameters to be chosen on-the-fly at each iteration. Compared to most recent work on generalized flexible Krylov methods [6] , our methods offer theoretical assurance of convergence and a more stable numerical performance. The efficiency of the new methods is shown through a variety of experiments, including a synthetic image deblurring problem, a synthetic atmospheric transport problem, and fluorescence molecular tomography reconstructions using both synthetic and real-world experimental data.

Two global iterative methods for ill-posed problems from image restoration

Global Quasi-Minimal Residual Method for Image Restoration

Tikhonov regularization with conjugate gradient least squares method for large-scale discrete ill-posed problem in image restoration

Inexact Global FOM and GMRES Methods for Solving Linear Systems with Multiple Right-Hand Sides

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

Two New Efficient Iterative Regularization Methods for Image Restoration Problems

Approximation Accuracy of the Krylov Subspaces for Linear Discrete Ill-Posed Problems

Restarted GMRES Method Augmented with the Combination of Harmonic Ritz Vectors and Error Approximations

Augmented Flexible Krylov Subspace methods with applications to Bayesian inverse problems

Global GMRES with Deflated Restarting for Families of Shifted Linear Systems

Matrix Forms of Iterative Algorithms to Solve Large-Scale Discrete Ill-Posed Problems with an Application to Image Restoration.

Discrete cosine transform LSQR and GMRES methods for multidimensional ill-posed problems

A new family of hybrid three-term conjugate gradient methods with applications in image restoration

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

On IGMRES: an Incomplete Generalized Minimal Residual Method for Large Unsymmetric Linear Systems

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems

An accelerated conjugate gradient method with adaptive two-parameter with applications in image restoration

Regularization Properties of Krylov Iterative Solvers CGME and LSMR for Linear Discrete Ill-Posed Problems with an Application to Truncated Randomized SVDs

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization