SIDGAN: Efficient Multi-Module Architecture for Single Image Defocus Deblurring

Shenggui Ling,Hongmin Zhan,Lijia Cao

DOI: https://doi.org/10.3390/electronics13122265

IF: 2.9

2024-06-10

Electronics

Abstract:In recent years, with the rapid developments in deep learning and graphics processing units, learning-based defocus deblurring has made favorable achievements. However, the current methods are not effective in processing blurred images with a large depth of field. The greater the depth of field, the blurrier the image, namely, the image contains large blurry regions and encounters severe blur. The fundamental reason for the unsatisfactory results is that it is difficult to extract effective features from the blurred images with large blurry regions. For this reason, a new FFEM (Fuzzy Feature Extraction Module) is proposed to enhance the encoder's ability to extract features from images with large blurry regions. After using the FFEM during encoding, its PSNR (Peak Signal-to-Noise Ratio) is improved by 1.33% on the DPDD (Dual-Pixel Defocus Deblurring). Moreover, images with large blurry regions often cause the current algorithms to generate artifacts in their results. Therefore, a new module named ARM (Artifact Removal Module) is proposed in this work and employed during decoding. After utilizing the ARM during decoding, its PSNR is improved by 2.49% on the DPDD. After using the FFEM and the ARM simultaneously, compared to the latest algorithms, the PSNR of our method is improved by 3.29% on the DPDD. Following the previous research in this field, qualitative and quantitative experiments are conducted on the DPDD and the RealDOF (Real Depth of Field), and the experimental results indicate that our method surpasses the state-of-the-art algorithms in three objective metrics.

engineering, electrical & electronic,computer science, information systems,physics, applied

What problem does this paper attempt to address?

The paper primarily focuses on addressing the problem of single image defocus deblurring, especially when the image has a large depth of field (DOF), resulting in large areas of blur. Existing methods perform poorly on such images. Specifically, the paper presents the following key contributions:

1. **Fuzzy Feature Extraction Module (FFEM)**: To effectively extract features from images with large areas of blur, the authors propose a new Fuzzy Feature Extraction Module (FFEM). This module is designed to enhance the encoder's ability to extract features from such images.

2. **Artifact Removal Module (ARM)**: During the decoding stage, current algorithms often produce artifacts in the resulting image. To address this issue, the authors propose a new Artifact Removal Module (ARM), which aims to remove these artifacts, thereby improving the quality of the final output image.

3. **SIDGAN Algorithm**: Combining the above two modules, the paper proposes a new algorithm named SIDGAN for single image defocus deblurring. This algorithm demonstrates superior performance over existing techniques in both quantitative and qualitative experiments, particularly when dealing with images containing large areas of blur.

By introducing FFEM and ARM, SIDGAN significantly improves the quality of image restoration when dealing with images with a large depth of field, especially achieving notable improvements in Peak Signal-to-Noise Ratio (PSNR). Experimental results show that this method excels in handling images with severe blur over large areas, capable of restoring images with clear structures and rich details while maintaining spatial smoothness in uniform regions.