Abstract:Most existing deep learning-based image denoisers heavily rely on supervised learning , where a denoising network is trained with massive noisy–clean training pairs. However, the lack of training pairs severely limits the applicability of this kind of denoisers in practice. Recently, an unsupervised denoiser, the so-called deep image prior (DIP), which can accomplish the task of noise removal only with the given noisy image itself, provides a great flexibility for those scenarios where acquiring a training image set is difficult, and has attracted extensive attention due to its practical significance and broad applications. However, the absence of external information dramatically reduces the upper bound of the denoising performance of the DIP method. In this paper, we propose a simple yet effective multi-channel approximation mechanism to boost the denoising performance of the DIP, where several representative denoisers are exploited to provide additional priors to ensure that the DIP model converges to a more reasonable position in the solution space during the iterative optimization process. Specifically, for a given noisy image, we first use two representative denoisers belonging to the internal and external prior-based denoising methods to denoise it, and the resulting denoised images are called initial denoised images that will be used as target images to constrain the search space. Then, the last layer of the original DIP model is expanded from single channel to multi-channel correspondingly, which allows the DIP model to produce multiple denoised images, called intermediate denoised images, in a single run. Thereby, the total execution time is considerably decreased. Meanwhile, we adopt a novel sharpness-based pseudo-reference image quality metric to automatically stop the iterative optimization process and ensure the image quality of the intermediate denoised images. Finally, the intermediate denoised images with good complementarity are fused to yield the final denoised image with structural patch decomposition-based fusion method. The extensive experiments on synthetic and real-world images show that the proposed method has superior performances over existing non-learning-based and learning-based methods.

Image Deconvolution with Deep Image and Kernel Priors

Multi-frame Blind Deconvolution Using Sparse Priors

Non-blind image deconvolution using natural image gradient prior

High quality non-blind image deconvolution using the Fields of Experts prior

A Deep Optimization Approach for Image Deconvolution.

Blind Image Deconvolution Using Variational Deep Image Prior

Blind Deconvolution Using an Improved L0 Sparse Representation

BP-DIP: A Backprojection based Deep Image Prior

Analysis of Deep Image Prior and Exploiting Self-Guidance for Image Reconstruction

Learning Deep Optimizer For Blind Image Deconvolution

Blind Image Deconvolution by Generative-based Kernel Prior and Initializer via Latent Encoding

Learning Discriminative Shrinkage Deep Networks for Image Deconvolution

Blind image deblurring via hybrid deep priors modeling

Deep Prior-Based Blind Image Deblurring

VDIP-TGV: Blind Image Deconvolution via Variational Deep Image Prior Empowered by Total Generalized Variation

Learning Deep Gradient Descent Optimization for Image Deconvolution

Tuning-free Plug-and-Play Hyperspectral Image Deconvolution with Deep Priors

Prior-guided Deep Residual Propagation for Non-Blind Image Deconvolution

Ua-Dip: Unsupervised Image Deblurring Via Admm and Deep Image Prior

Multi-channel deep image prior for image denoising

SDIP: Self-Reinforcement Deep Image Prior Framework for Image Processing