Abstract:Most existing deep learning-based image restoration methods usually aim to remove degradation with uniform spatial distribution and constant intensity, making insufficient use of degradation prior knowledge. Here we bootstrap the deep neural networks to suppress complex image degradation whose intensity is spatially variable, through utilizing prior knowledge from degraded images. Specifically, we propose an ingenious and efficient multi-frame image restoration network (DparNet) with wide & deep architecture, which integrates degraded images and prior knowledge of degradation to reconstruct images with ideal clarity and stability. The degradation prior is directly learned from degraded images in form of key degradation parameter matrix, with no requirement of any off-site knowledge. The wide & deep architecture in DparNet enables the learned parameters to directly modulate the final restoring results, boosting spatial & intensity adaptive image restoration. We demonstrate the proposed method on two representative image restoration applications: image denoising and suppression of atmospheric turbulence effects in images. Two large datasets, containing 109,536 and 49,744 images respectively, were constructed to support our experiments. The experimental results show that our DparNet significantly outperform SoTA methods in restoration performance and network efficiency. More importantly, by utilizing the learned degradation parameters via wide & deep learning, we can improve the PSNR of image restoration by 0.6~1.1 dB with less than 2% increasing in model parameter numbers and computational complexity. Our work suggests that degraded images may hide key information of the degradation process, which can be utilized to boost spatial & intensity adaptive image restoration.

Image Restoration Based on Transformed Total Variation and Deep Image prior

Image Restoration using Total Variation Regularized Deep Image Prior

Hybrid regularization inspired by total variation and deep denoiser prior for image restoration

Discrete Total Variation Model with Gradient Fidelity Term for Image Restoration

VDIP-TGV: Blind Image Deconvolution via Variational Deep Image Prior Empowered by Total Generalized Variation

Wide & deep learning for spatial & intensity adaptive image restoration

BP-DIP: A Backprojection based Deep Image Prior

Plug-and-Play Image Restoration with Deep Denoiser Prior

An Efficient Non-Convex Total Variation Approach for Image Deblurring and Denoising

Image Restoration by Combined Order Regularization with Optimal Spatial Adaptation

A Bayesian Adaptive Weighted Total Generalized Variation Model for Image Restoration

Total Generalized Variation Restoration with Non-Quadratic Fidelity

Learning Spatially Variant Degradation for Unsupervised Blind Photoacoustic Tomography Image Restoration

Ua-Dip: Unsupervised Image Deblurring Via Admm and Deep Image Prior

Bayesian image restoration using a large-scale total patch variation prior

Denoising Prior Driven Deep Neural Network for Image Restoration

High-order TVL1-based images restoration and spatially adapted regularization parameter selection.

Boosting Image Restoration via Priors from Pre-trained Models

Analysis of Deep Image Prior and Exploiting Self-Guidance for Image Reconstruction

Image restoration using total variation with overlapping group sparsity

Compressive total variation for image reconstruction and restoration