Abstract:Image deblurring aims to recover the latent sharp image from its blurry counterpart and has a wide range of applications in computer vision. The Convolution Neural Networks (CNNs) have performed well in this domain for many years, and until recently an alternative network architecture, namely Transformer, has demonstrated even stronger performance. One can attribute its superiority to the multi-head self-attention (MHSA) mechanism, which offers a larger receptive field and better input content adaptability than CNNs. However, as MHSA demands high computational costs that grow quadratically with respect to the input resolution, it becomes impractical for high-resolution image deblurring tasks. In this work, we propose a unified lightweight CNN network that features a large effective receptive field (ERF) and demonstrates comparable or even better performance than Transformers while bearing less computational costs. Our key design is an efficient CNN block dubbed LaKD, equipped with a large kernel depth-wise convolution and spatial-channel mixing structure, attaining comparable or larger ERF than Transformers but with a smaller parameter scale. Specifically, we achieve +0.17dB / +0.43dB PSNR over the state-of-the-art Restormer on defocus / motion deblurring benchmark datasets with 32% fewer parameters and 39% fewer MACs. Extensive experiments demonstrate the superior performance of our network and the effectiveness of each module. Furthermore, we propose a compact and intuitive ERFMeter metric that quantitatively characterizes ERF, and shows a high correlation to the network performance. We hope this work can inspire the research community to further explore the pros and cons of CNN and Transformer architectures beyond image deblurring tasks.

Image Deblurring Based on Fast Convolutional Neural Networks

Guided Image Deblurring by Deep Multi-Modal Image Fusion.

Single Image Deblurring with Cross-Layer Feature Fusion and Consecutive Attention

A Concatenated Residual Network for Image Deblurring.

A multi-task approach to face deblurring

Motion Deblurring Based on Convolutional Neural Network

Nonblind Image Deblurring Via Deep Learning in Complex Field

Adaptive Optimized Discriminative Learning based Image Deblurring using Deep CNN

Deblurring microscopic image by integrated convolutional neural network

Learning To Deblur Face Images Via Sketch Synthesis

Revisiting Image Deblurring with an Efficient ConvNet

Reference-guided deep deblurring via a selective attention network

CNB Net: A Two-Stage Approach for Effective Image Deblurring

Image Denoising Based On A Cnn Model

Efficient Dynamic Scene Deblurring Using Spatially Variant Deconvolution Network with Optical Flow Guided Training.

Deep Dynamic Scene Deblurring from Optical Flow

Learning a Non-blind Deblurring Network for Night Blurry Images

DeepDeblur: Fast one-step blurry face images restoration

Multi-Attention Convolutional Neural Network for Video Deblurring

Deep Semantic Face Deblurring

Image Restoration Based on Deep Convolutional Network in Wavefront Coding Imaging System.