Abstract:SIAM Review, Volume 66, Issue 2, Page 205-284, May 2024. This paper surveys an important class of methods that combine iterative projection methods and variational regularization methods for large-scale inverse problems. Iterative methods such as Krylov subspace methods are invaluable in the numerical linear algebra community and have proved important in solving inverse problems due to their inherent regularizing properties and their ability to handle large-scale problems. Variational regularization describes a broad and important class of methods that are used to obtain reliable solutions to inverse problems, whereby one solves a modified problem that incorporates prior knowledge. Hybrid projection methods combine iterative projection methods with variational regularization techniques in a synergistic way, providing researchers with a powerful computational framework for solving very large inverse problems. Although the idea of a hybrid Krylov method for linear inverse problems goes back to the 1980s, several recent advances on new regularization frameworks and methodologies have made this field ripe for extensions, further analyses, and new applications. In this paper, we provide a practical and accessible introduction to hybrid projection methods in the context of solving large (linear) inverse problems.

Hybrid Hu-Storey type methods for large-scale nonlinear monotone systems and signal recovery

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

Stability Analysis of Large-scale Nonlinear Systems with Hybrid Models

The convergence of conjugate gradient method with nonmonotone line search

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

A derivative-free memoryless BFGS hyperplane projection method for solving large-scale nonlinear monotone equations

A multivariate spectral hybridization of HS and PRP method for nonlinear systems of equations

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems

Two Descent Dai-Yuan Conjugate Gradient Methods for Systems of Monotone Nonlinear Equations

A diagonal PRP-type projection method for convex constrained nonlinear monotone equations

Fast Hybrid Algorithm for Big Matrix Recovery

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

A Modified Spectral PRP Conjugate Gradient Projection Method for Solving Large-Scale Monotone Equations and Its Application in Compressed Sensing

An inertial Fletcher–Reeves-type conjugate gradient projection-based method and its spectral extension for constrained nonlinear equations

A Modified Three-Term Conjugate Descent Derivative-Free Method for Constrained Nonlinear Monotone Equations and Signal Reconstruction Problems

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

Computational Methods for Large-Scale Inverse Problems: A Survey on Hybrid Projection Methods

Modification of a conjugate gradient approach for convex constrained nonlinear monotone equations with applications in signal recovery and image restoration

A Modified Spectral Conjugate Gradient Projection Method for Signal Recovery.

A Two-Step Spectral Gradient Projection Method for System of Nonlinear Monotone Equations and Image Deblurring Problems