Occlusion-Aware Video Deblurring with a New Layered Blur Model

Byeongjoo Ahn,Tae Hyun Kim,Wonsik Kim,Kyoung Mu Lee

DOI: https://doi.org/10.48550/arXiv.1611.09572

2016-11-29

Abstract:We present a deblurring method for scenes with occluding objects using a carefully designed layered blur model. Layered blur model is frequently used in the motion deblurring problem to handle locally varying blurs, which is caused by object motions or depth variations in a scene. However, conventional models have a limitation in representing the layer interactions occurring at occlusion boundaries. In this paper, we address this limitation in both theoretical and experimental ways, and propose a new layered blur model reflecting actual blur generation process. Based on this model, we develop an occlusion-aware deblurring method that can estimate not only the clear foreground and background, but also the object motion more accurately. We also provide a novel analysis on the blur kernel at object boundaries, which shows the distinctive characteristics of the blur kernel that cannot be captured by conventional blur models. Experimental results on synthetic and real blurred videos demonstrate that the proposed method yields superior results, especially at object boundaries.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenge of dealing with occluded objects in video deblurring. Specifically, traditional deblurring methods will produce serious artifacts (such as ringing effects) when dealing with scenes with occlusions, especially at the occlusion boundaries. These problems are mainly due to the fact that the traditional layered blur model fails to accurately reflect the actual blur generation process, especially that the inter - layer interactions at the occlusion boundaries are not fully considered.

To solve this problem, the author proposes a new layered blur model and develops an occlusion - aware video deblurring method based on this model. This method can not only estimate the clear foreground and background more accurately, but also recover the object motion more precisely. Verified by experiments, this method performs well on both synthetic and real - life blurred videos, especially at the occlusion boundaries.

### Main contributions of the paper:
1. **New layered blur model**: A new model is proposed, which more accurately reflects the actual blur generation process by changing the layer combination and the order of blurring.
2. **Occlusion - aware deblurring method**: Based on the new model, a video deblurring method that can handle occlusions is developed, which can more accurately restore clear foreground, background and motion information.
3. **Theoretical and experimental analysis**: A theoretical and experimental comparison between the traditional layered blur model and the new model is carried out, showing the advantages of the new model at the occlusion boundaries.
4. **Experimental results**: Experiments are carried out on synthetic and real - life blurred videos to verify the effectiveness of the new method, especially its performance at the occlusion boundaries is better than that of existing methods.

### Solutions to specific problems:
- **Artifacts at occlusion boundaries**: Through a more accurate layered blur model, the ringing effect and other artifacts at the occlusion boundaries are reduced.
- **Handling of multi - layer motion**: The new model can better handle the situation where the foreground and background move simultaneously, improving the accuracy of deblurring.
- **Robustness**: The new method is more stable and reliable when dealing with different types of blurred videos.

In conclusion, by proposing a new layered blur model and the corresponding deblurring method, this paper solves the shortcomings of traditional methods in dealing with occlusions, providing new ideas and methods for the development of video deblurring technology.