Abstract:Most existing deep learning-based image restoration methods usually aim to remove degradation with uniform spatial distribution and constant intensity, making insufficient use of degradation prior knowledge. Here we bootstrap the deep neural networks to suppress complex image degradation whose intensity is spatially variable, through utilizing prior knowledge from degraded images. Specifically, we propose an ingenious and efficient multi-frame image restoration network (DparNet) with wide & deep architecture, which integrates degraded images and prior knowledge of degradation to reconstruct images with ideal clarity and stability. The degradation prior is directly learned from degraded images in form of key degradation parameter matrix, with no requirement of any off-site knowledge. The wide & deep architecture in DparNet enables the learned parameters to directly modulate the final restoring results, boosting spatial & intensity adaptive image restoration. We demonstrate the proposed method on two representative image restoration applications: image denoising and suppression of atmospheric turbulence effects in images. Two large datasets, containing 109,536 and 49,744 images respectively, were constructed to support our experiments. The experimental results show that our DparNet significantly outperform SoTA methods in restoration performance and network efficiency. More importantly, by utilizing the learned degradation parameters via wide & deep learning, we can improve the PSNR of image restoration by 0.6~1.1 dB with less than 2% increasing in model parameter numbers and computational complexity. Our work suggests that degraded images may hide key information of the degradation process, which can be utilized to boost spatial & intensity adaptive image restoration.

Dynamic Attentive Graph Learning for Image Restoration

Graph Attention Neural Network for Image Restoration.

Improved Restoration Algorithm for Weakly Blurred and Strongly Noisy Image

Graph Convolutional Network for Image Restoration: A Survey

Residual Non-local Attention Networks for Image Restoration

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

High-dimensional Assisted Generative Model for Color Image Restoration

Deep Graph Laplacian Regularization for Robust Denoising of Real Images

COLA-Net: Collaborative Attention Network for Image Restoration

Progressive Image Restoration Through Hybrid Graph Laplacian Regularization

Efficient and Explicit Modelling of Image Hierarchies for Image Restoration

Enhancing Local–Global Representation Learning for Image Restoration

Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A Unified Framework

Robust image restoration via adaptive low-rank approximation and joint kernel regression.

Image Restoration Based On Adaptive Dual-Domain Filtering

Deep Denoiser Prior Based Deep Analytic Network for Lensless Image Restoration.

Multiscale Synergism Ensemble Progressive and Contrastive Investigation for Image Restoration

Iterative Learning for Distorted Image Restoration

Synergic feature attention for image restoration

DARGS: Image Inpainting Algorithm via Deep Attention Residuals Group and Semantics

Wide & deep learning for spatial & intensity adaptive image restoration