Abstract:Regularization is necessary when solving inverse problems to ensure the well-posedness of the solution map. Additionally, it is desired that the chosen regularization strategy is convergent in the sense that the solution map converges to a solution of the noise-free operator equation. This provides an important guarantee that stable solutions can be computed for all noise levels and that solutions satisfy the operator equation in the limit of vanishing noise. In recent years, reconstructions in inverse problems are increasingly approached from a data-driven perspective. Despite empirical success, the majority of data-driven approaches do not provide a convergent regularization strategy. One such popular example is given by iterative plug-and-play (PnP) denoising using off-the-shelf image denoisers. These usually provide only convergence of the PnP iterates to a fixed point, under suitable regularity assumptions on the denoiser, rather than convergence of the method as a regularization technique, thatis under vanishing noise and regularization strength. This paper serves two purposes: first, we provide an overview of the classical regularization theory in inverse problems and survey a few notable recent data-driven methods that are provably convergent regularization schemes. We then continue to discuss PnP algorithms and their established convergence guarantees. Subsequently, we consider PnP algorithms with learned linear denoisers and propose a novel spectral filtering technique of the denoiser to control the strength of regularization. Further, by relating the implicit regularization of the denoiser to an explicit regularization functional, we are the first to rigorously show that PnP with a learned linear denoiser leads to a convergent regularization scheme. The theoretical analysis is corroborated by numerical experiments for the classical inverse problem of tomographic image reconstruction.

Regularisation and central limit theorems for an inverse problem in network sampling applications

Structure Learning in Inverse Ising Problems Using ℓ_2-Regularized Linear Estimator

Statistical inverse problems in active network tomography

Off-the-grid regularisation for Poisson inverse problems

Regularization of linear inverse problems with irregular noise using embedding operators

Statistical inverse learning problems with random observations

Depicting Network Structures from Variable Data Produced by Unknown Colored-Noise Driven Dynamics

On the Asymptotical Regularization for Linear Inverse Problems in Presence of White Noise

Big in Japan: Regularizing networks for solving inverse problems

Investigating complex networks with inverse models: analytical aspects of spatial leakage and connectivity estimation

A posterior contraction for Bayesian inverse problems in Banach spaces

Convergent Regularization in Inverse Problems and Linear Plug-and-Play Denoisers

Attribute network models, stochastic approximation, and network sampling and ranking algorithms

A Poincaré Inequality and Consistency Results for Signal Sampling on Large Graphs

On some information-theoretic aspects of non-linear statistical inverse problems

Regularized Brascamp--Lieb inequalities

Randomized Matrix Approximation to Enhance Regularized Projection Schemes in Inverse Problems

Sparse bayesian inference with regularized gaussian distributions

Convergence Rate Analysis of Tikhonov Regularization for Nonlinear Ill-Posed Problems with Noisy Operators

A class of regularizations based on nonlinear isotropic diffusion for inverse problems