Abstract:Regularization is necessary when solving inverse problems to ensure the well-posedness of the solution map. Additionally, it is desired that the chosen regularization strategy is convergent in the sense that the solution map converges to a solution of the noise-free operator equation. This provides an important guarantee that stable solutions can be computed for all noise levels and that solutions satisfy the operator equation in the limit of vanishing noise. In recent years, reconstructions in inverse problems are increasingly approached from a data-driven perspective. Despite empirical success, the majority of data-driven approaches do not provide a convergent regularization strategy. One such popular example is given by iterative plug-and-play (PnP) denoising using off-the-shelf image denoisers. These usually provide only convergence of the PnP iterates to a fixed point, under suitable regularity assumptions on the denoiser, rather than convergence of the method as a regularization technique, thatis under vanishing noise and regularization strength. This paper serves two purposes: first, we provide an overview of the classical regularization theory in inverse problems and survey a few notable recent data-driven methods that are provably convergent regularization schemes. We then continue to discuss PnP algorithms and their established convergence guarantees. Subsequently, we consider PnP algorithms with learned linear denoisers and propose a novel spectral filtering technique of the denoiser to control the strength of regularization. Further, by relating the implicit regularization of the denoiser to an explicit regularization functional, we are the first to rigorously show that PnP with a learned linear denoiser leads to a convergent regularization scheme. The theoretical analysis is corroborated by numerical experiments for the classical inverse problem of tomographic image reconstruction.

Comparison of the PDE-Based Regularization Methods and a Unifying Framework

Diffusion behavior of regularization and a unified framework

Convergent Regularization in Inverse Problems and Linear Plug-and-Play Denoisers

Monotonically Convergent Regularization by Denoising

Unified Regularization Framework for Blind Image Super-Resolution

Curvelet Regularized Nonlinear Anisotropic Diffusion

Image Deblurring Based on Convex Non-Convex Sparse Regularization and Plug-and-Play Algorithm

Application of Regularization in Sparse-View Photoacoustic Imaging Reconstruction

Learning Partial Differential Equations for Computer Vision ∗

Guided Regularization and its Application for Image Restoration

Joint Non-Local Statistical and Wavelet Tight Frame Information-Based l0 Regularization Model for Image Deblurring

High-order Total Variation-Based Poissonian Image Deconvolution with Spatially Adapted Regularization Parameter

Error Estimates for Data-driven Weakly Convex Frame-based Image Regularization

The Little Engine that Could: Regularization by Denoising (RED)

A Unified Regularization Framework for Virtual Frontal Face Image Synthesis

A Novel Framework Method for Non-Blind Deconvolution Using Subspace Images Priors

Image denoising via nonlinear hybrid diffusion

Learning Pdes For Image Restoration Via Optimal Control

Global Structure-Aware Diffusion Process for Low-Light Image Enhancement

Nonlocal sparse and low-rank regularization for optical flow estimation.