Abstract:Deep learning-based image deblurring techniques have made great advancements, improving both processing speed and deblurring efficacy. However, existing methods still face challenges when dealing with complex blur types and the semantic understanding of images. The segment anything model (SAM), a versatile deep learning model that accurately and efficiently segments objects in images, facilitates various tasks in computer vision. This article leverages SAM's proficiency in capturing object edges and enhancing image content comprehension to improve image deblurring. We introduce the edge-sensitive focusing encoder (EFE) module, which utilizes masks generated by the SAM framework and re-weights the masked portion following SAM segmentation by detecting its features and high-frequency information. The EFE module uses the masks to locate the position of the blur in an image while identifying the intensity of the blur, allowing the model to focus more accurately on specific features. Masks with greater high-frequency information are assigned higher weights, prompting the network to prioritize them during processing. Based on the EFE module, we develop a deblurring network called the edge-sensitive focusing encoder-based convolution–normalization and attention network (EFE-CNA Net), which utilizes the EFE module to enhance the deblurring process, employs an image-mask decoder to merge features from both the image and the mask from the EFE module, and incorporates the CNA Net as its base network. This design enables the model to focus on distinct features at various locations, enhancing its learning process through the guidance provided by the EFE module and the blurred images. Testing results on the RealBlur and REDS datasets demonstrate the effectiveness of the EFE-CNA Net, achieving peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) metrics of 28.77, 0.902 (RealBlur-J), 36.40, 0.956 (RealBlur-R), 31.45, and 0.919 (REDS).

Blurring-Effect-Free Cnn For Optimization Of Structural Edges In Focus Stacking

Blurring-Effect-Free Cnn Network Of Structural Edge For Focus Stacking

StackMFF: End-to-end Multi-Focus Image Stack Fusion Network

Scene-Adaptive Image Acquisition for Focus Stacking.

Depth-Based Focus Stacking With Labeled-Laplacian Propagation

All-in-focus with Directional-Max-gradient Flow and Labeled Iterative Depth Propagation.

Deep Multi-Scale Feature Learning for Defocus Blur Estimation

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

CCSR-Net: Unfolding Coupled Convolutional Sparse Representation for Multi-focus Image Fusion.

Deblurring microscopic image by integrated convolutional neural network

AIFNet: All-in-Focus Image Restoration Network Using a Light Field-Based Dataset

Defocus Blur detection via transformer encoder and edge guidance

A multi-task approach to face deblurring

Hybrid All-in-focus Imaging from Neuromorphic Focal Stack

All-in-Focus Imaging from Event Focal Stack.

CNB Net: A Two-Stage Approach for Effective Image Deblurring

Improving defocus blur detection via adaptive supervision prior-tokens

BaMBNet: A Blur-aware Multi-branch Network for Defocus Deblurring

DeFusionNET: Defocus Blur Detection via Recurrently Fusing and Refining Discriminative Multi-Scale Deep Features

EFE-CNA Net: An Approach for Effective Image Deblurring Using an Edge-Sensitive Focusing Encoder

Large Aperture Focus Stacking with Max-Gradient Flow by Anchored Rolling Filtering