Abstract:Image deblurring aims to recover the latent sharp image from its blurry counterpart and has a wide range of applications in computer vision. The Convolution Neural Networks (CNNs) have performed well in this domain for many years, and until recently an alternative network architecture, namely Transformer, has demonstrated even stronger performance. One can attribute its superiority to the multi-head self-attention (MHSA) mechanism, which offers a larger receptive field and better input content adaptability than CNNs. However, as MHSA demands high computational costs that grow quadratically with respect to the input resolution, it becomes impractical for high-resolution image deblurring tasks. In this work, we propose a unified lightweight CNN network that features a large effective receptive field (ERF) and demonstrates comparable or even better performance than Transformers while bearing less computational costs. Our key design is an efficient CNN block dubbed LaKD, equipped with a large kernel depth-wise convolution and spatial-channel mixing structure, attaining comparable or larger ERF than Transformers but with a smaller parameter scale. Specifically, we achieve +0.17dB / +0.43dB PSNR over the state-of-the-art Restormer on defocus / motion deblurring benchmark datasets with 32% fewer parameters and 39% fewer MACs. Extensive experiments demonstrate the superior performance of our network and the effectiveness of each module. Furthermore, we propose a compact and intuitive ERFMeter metric that quantitatively characterizes ERF, and shows a high correlation to the network performance. We hope this work can inspire the research community to further explore the pros and cons of CNN and Transformer architectures beyond image deblurring tasks.

Reversible Autoencoder: A CNN-Based Nonlinear Lifting Scheme for Image Reconstruction

Dilated Residual Encode-Decode Networks for Image Denoising

Cascade Decoders-Based Autoencoders for Image Reconstruction

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Deep Learning-Guided Image Reconstruction from Incomplete Data

Data Reconstruction Based on Supervised Deep Auto-Encoder.

Image Restoration Using Convolutional Auto-encoders with Symmetric Skip Connections.

An End-to-End Compression Framework Based on Convolutional Neural Networks

Learning Deep Representations Using Convolutional Auto-Encoders with Symmetric Skip Connections

Non-Local Auto-Encoder With Collaborative Stabilization for Image Restoration.

Image Restoration Based on End-to-End Unrolled Network

Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations

Interactive reconstruction of Monte Carlo image sequences using a recurrent denoising autoencoder

Revisiting Image Deblurring with an Efficient ConvNet

Multi-level Encoder-Decoder Architectures for Image Restoration

Better and Faster, when ADMM Meets CNN: Compressive-Sensed Image Reconstruction

Defense Against Adversarial Attacks by Reconstructing Images

Reconstructing Natural Images from Human Fmri by Alternating Encoding and Decoding with Shared Autoencoder Regularization

Layered Image Compression Using Scalable Auto-Encoder

Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections.