Joint Learning of Motion Deblurring and Defocus Deblurring Networks with a Real-World Dataset

Yu Li,Xinya Shu,Dongwei Ren,Qince Li,Wangmeng Zuo
DOI: https://doi.org/10.1016/j.neucom.2023.126996
IF: 6
2023-01-01
Neurocomputing
Abstract:When recovering the sharp image from a blurry observation, moving objects, e.g., people and vehicles, usually attract more perceptual attention. However, existing motion deblurring methods primarily focus on removing the global camera motion blur, while neglecting the object motion blur. In this paper, we propose a joint learning framework for motion deblurring and defocus deblurring (JLMD), where a motion deblurring network can be trained for removing object motion blur, and a defocus deblurring network can be also obtained as a byproduct. Especially, we propose to circumvent the hardship in obtaining all-sharp ground truth for object motion blurry images by leveraging the complementary nature between object motion blur and defocus blur. The JLMD framework incorporates three key components. Firstly, a mask generation module is deployed to predict the boundary of motion blur. Secondly, a mutual supervision mechanism is elaborated, which enables the defocus blurry image and the motion blurry image to serve as the ground truth for each other. Thirdly, a content preservation loss is designed to encourage non-blurry regions to stay unchanged. Furthermore, we introduce a Defocus and Motion Deblurring Dataset (DMDD), which is the first real-world dataset specifically dedicated to object motion blurry images. Extensive experiments validate that our method is more effective in removing object motion blur than state-of-the-art methods, while it is at least comparable or superior in removing global camera motion blur and defocus blur. The source code and dataset are available at https://github.com/liyucs/JLMD.
What problem does this paper attempt to address?