Abstract:Deep learning-based image deblurring techniques have made great advancements, improving both processing speed and deblurring efficacy. However, existing methods still face challenges when dealing with complex blur types and the semantic understanding of images. The segment anything model (SAM), a versatile deep learning model that accurately and efficiently segments objects in images, facilitates various tasks in computer vision. This article leverages SAM's proficiency in capturing object edges and enhancing image content comprehension to improve image deblurring. We introduce the edge-sensitive focusing encoder (EFE) module, which utilizes masks generated by the SAM framework and re-weights the masked portion following SAM segmentation by detecting its features and high-frequency information. The EFE module uses the masks to locate the position of the blur in an image while identifying the intensity of the blur, allowing the model to focus more accurately on specific features. Masks with greater high-frequency information are assigned higher weights, prompting the network to prioritize them during processing. Based on the EFE module, we develop a deblurring network called the edge-sensitive focusing encoder-based convolution–normalization and attention network (EFE-CNA Net), which utilizes the EFE module to enhance the deblurring process, employs an image-mask decoder to merge features from both the image and the mask from the EFE module, and incorporates the CNA Net as its base network. This design enables the model to focus on distinct features at various locations, enhancing its learning process through the guidance provided by the EFE module and the blurred images. Testing results on the RealBlur and REDS datasets demonstrate the effectiveness of the EFE-CNA Net, achieving peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) metrics of 28.77, 0.902 (RealBlur-J), 36.40, 0.956 (RealBlur-R), 31.45, and 0.919 (REDS).

RETRACTED ARTICLE: A Method of Fuzzy Enhancement for Degraded Image Based on Deep Learning

Research on Digital Meter Reading Method of Inspection Robot Based on Deep Learning

Guided Image Deblurring by Deep Multi-Modal Image Fusion.

An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism

Image enhancement using deep-learning fully connected neural network mean filter

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

Image Deblurring Using Multi-Stream Bottom-Top-Bottom Attention Network and Global Information-Based Fusion and Reconstruction Network

Reference-guided deep deblurring via a selective attention network

Effective video deblurring based on feature-enhanced deep learning network for daytime and nighttime images

Feature Enhancement Method for Fuzzy Image Using Mathematical Morphology and Deep Learning

Image Dehazing Technique Based on DenseNet and the Denoising Self-Encoder

Reference-Based Multi-Level Features Fusion Deblurring Network for Optical Remote Sensing Images

Image Deblurring With Image Blurring

DeFusionNET: Defocus Blur Detection via Recurrently Fusing and Refining Discriminative Multi-Scale Deep Features

Enhancing Image Quality: A Comparative Study of Spatial, Frequency Domain, and Deep Learning Methods

Deep Learning-Based Technique for Remote Sensing Image Enhancement Using Multiscale Feature Fusion

EFE-CNA Net: An Approach for Effective Image Deblurring Using an Edge-Sensitive Focusing Encoder

Learning a Non-blind Deblurring Network for Night Blurry Images

Perceptual Quality Enhancement with Multi-scale Deep Learning for Video Transmission: A QoE Perspective

EDPN: Enhanced Deep Pyramid Network for Blurry Image Restoration

Deep motion blur removal using noisy/blurry image pairs