Abstract:Aiming at the non-uniform blurring of image caused by optical system defects or external interference factors, such as camera shake, out-of-focus, and fast movement of object, a multi-scale cyclic image deblurring model based on a parallel void convolution-Resnet (PVC-Resnet) is proposed in this paper, in which a multi-scale recurrent network architecture and a coarse-to-fine strategy are used to restore blurred images. The backbone network is built based on Unet codec architecture, where a PVC-Resnet module designed by combinations of parallel dilated convolution and residual network is constructed in the encoder of the backbone network. The convolution receptive field is expanded with parallel dilated convolution to extract richer global features. Besides, a multi-scale feature extraction module is designed to extract the shallow features of different scale targets in blurred images, and then the extracted features are sent to the backbone network for feature refinement. The SSIM loss function and the L1 loss function are combined to construct the SSIM-L1 joint loss function for the optimization of the overall network to ensure that the image restoration at different stages can be optimized. The experimental results show that the average peak signal-to-noise ratio (PSNR) of the proposed model on different data sets is as high as 32.84 dB, and the structural similarity (SSIM) reaches 0.9235. and statistical structural similarity (Stat-SSIM) of 0.9249 on different datasets. Compared with other methods, the deblurred images generated by this method are superior to the methods proposed by Nah et al., Kupyn et al. and Cho S J et al., especially on the calibration board data set. The model proposed in this paper applies parallel dilated convolution and SSIM-L1 joint loss function to improve the performance of the network so that the edge and texture details of the restored image are clearer.

Multi-scale Deformable Deblurring Kernel Prediction for Dynamic Scene Deblurring

Dilated kernel prediction network for

Dynamic Selection of Proper Kernels for Image Deblurring: a Multistrategy Design.

Efficiently Exploiting Spatially Variant Knowledge for Video Deblurring

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

Image Deblurring With Image Blurring

Efficient Multi-scale Network with Learnable Discrete Wavelet Transform for Blind Motion Deblurring

Learning an Occlusion-Aware Network for Video Deblurring

Motion Blur Kernel Estimation Via Deep Learning

Single-image Defocus Deblurring by Integration of Defocus Map Prediction Tracing the Inverse Problem Computation

Multi-scale network for single image deblurring based on ensemble learning module

Efficient multi-stage network with pixel-wise degradation prediction for real-time motion deblurring

Self-Supervised Multi-Scale Network for Blind Image Deblurring via Alternating Optimization

Deep motion blur removal using noisy/blurry image pairs

Deep Dynamic Scene Deblurring from Optical Flow

Online Video Deblurring via Dynamic Temporal Blending Network

Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild

A Multi-scale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing

A Multiscale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing

Multi-Scale Cyclic Image Deblurring Based on PVC-Resnet