Abstract:Most existing deep learning-based image denoisers heavily rely on supervised learning , where a denoising network is trained with massive noisy–clean training pairs. However, the lack of training pairs severely limits the applicability of this kind of denoisers in practice. Recently, an unsupervised denoiser, the so-called deep image prior (DIP), which can accomplish the task of noise removal only with the given noisy image itself, provides a great flexibility for those scenarios where acquiring a training image set is difficult, and has attracted extensive attention due to its practical significance and broad applications. However, the absence of external information dramatically reduces the upper bound of the denoising performance of the DIP method. In this paper, we propose a simple yet effective multi-channel approximation mechanism to boost the denoising performance of the DIP, where several representative denoisers are exploited to provide additional priors to ensure that the DIP model converges to a more reasonable position in the solution space during the iterative optimization process. Specifically, for a given noisy image, we first use two representative denoisers belonging to the internal and external prior-based denoising methods to denoise it, and the resulting denoised images are called initial denoised images that will be used as target images to constrain the search space. Then, the last layer of the original DIP model is expanded from single channel to multi-channel correspondingly, which allows the DIP model to produce multiple denoised images, called intermediate denoised images, in a single run. Thereby, the total execution time is considerably decreased. Meanwhile, we adopt a novel sharpness-based pseudo-reference image quality metric to automatically stop the iterative optimization process and ensure the image quality of the intermediate denoised images. Finally, the intermediate denoised images with good complementarity are fused to yield the final denoised image with structural patch decomposition-based fusion method. The extensive experiments on synthetic and real-world images show that the proposed method has superior performances over existing non-learning-based and learning-based methods.

Deep Image Prior and Weighted Anisotropic-Isotropic Total Variation Regularization for Solving Linear Inverse Problems

A Graph-based Iterative Algorithm for Inverse Problems with Local and Non-local Regularizations

Image Restoration using Total Variation Regularized Deep Image Prior

Image Restoration Based on Transformed Total Variation and Deep Image prior

An Efficient Non-Convex Total Variation Approach for Image Deblurring and Denoising

Solving Inverse Problems with Hybrid Deep Image Priors: the challenge of preventing overfitting

A Deep Optimization Approach for Image Deconvolution.

VDIP-TGV: Blind Image Deconvolution via Variational Deep Image Prior Empowered by Total Generalized Variation

Analysis of Deep Image Prior and Exploiting Self-Guidance for Image Reconstruction

DRIP: Deep Regularizers for Inverse Problems

Image Reconstruction via Deep Image Prior Subspaces

Ua-Dip: Unsupervised Image Deblurring Via Admm and Deep Image Prior

Multi-channel deep image prior for image denoising

ADMM-ADAM: A New Inverse Imaging Framework Blending the Advantages of Convex Optimization and Deep Learning

Blind Image Deconvolution Using Variational Deep Image Prior

One-dimensional Deep Image Prior for Time Series Inverse Problems

BP-DIP: A Backprojection based Deep Image Prior

An efficient plug-and-play regularization method for full waveform inversion

Sketched Equivariant Imaging Regularization and Deep Internal Learning for Inverse Problems

Inertial Nonconvex Alternating Minimizations for the Image Deblurring

Image Deconvolution with Deep Image and Kernel Priors