Abstract:Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography. It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods. Due to its great breakthrough in low-level tasks, convolutional neural networks (CNNs) have been introduced to the defocus deblurring problem and achieved significant progress. However, previous methods apply the same learned kernel for different regions of the defocus blurred images, thus it is difficult to handle nonuniform blurred images. To this end, this study designs a novel blur-aware multi-branch network (Ba-MBNet), in which different regions are treated differentially. In particular, we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel (DP) data, which measures the defocus disparity between the left and right views. Based on the assumption that different image regions with different blur amounts have different deblurring difficulties, we leverage different networks with different capacities to treat different image regions. Moreover, we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch. In this way, we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions. Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art (SOTA) methods. For the dual-pixel defocus deblurring (DPD)-blur dataset, the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio (PSNR) and reduces learnable parameters by 85%. The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.

Defocus Image Deblurring Network With Defocus Map Estimation as Auxiliary Task

Single-image Defocus Deblurring by Integration of Defocus Map Prediction Tracing the Inverse Problem Computation

Defocus Deblurring: a Designed Deep Model Based on CNN

Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs

Defusionnet: Defocus Blur Detection Via Recurrently Fusing And Refining Multi-Scale Deep Features

BaMBNet: A Blur-aware Multi-branch Network for Defocus Deblurring

Learning an Occlusion-Aware Network for Video Deblurring

Learning to Deblur using Light Field Generated and Real Defocus Images

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

DeFusionNET: Defocus Blur Detection via Recurrently Fusing and Refining Discriminative Multi-Scale Deep Features

Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild

BaMBNet: A Blur-Aware Multi-Branch Network for Dual-Pixel Defocus Deblurring

Iterative Filter Adaptive Network for Single Image Defocus Deblurring

Defocus Deblurring Using Dual-Pixel Data

Joint Learning of Motion Deblurring and Defocus Deblurring Networks with a Real-World Dataset

Single image deep defocus estimation and its applications

Efficient Fusion of Depth Information for Defocus Deblurring.

Learning Dual-Pixel Alignment for Defocus Deblurring

Attacking Defocus Detection With Blur-Aware Transformation for Defocus Deblurring

AIFNet: All-in-Focus Image Restoration Network Using a Light Field-Based Dataset

Depth Estimation and Image Restoration by Deep Learning from Defocused Images