Hierarchical Hole Filling for Novel View Synthesis

xin du,gang ye,yunfang zhu,huiliang shen

DOI: https://doi.org/10.1007/978-3-642-35286-7_44

2012-01-01

Abstract:Novel view synthesis is a key technique in 3DTV. It usually uses depth maps as input. However, obtaining an accurate depth map from stereo images is hard even for the state-of-art stereo matching algorithms. When rendering based on the erroneous depth map, the resulting novel view will contain artifacts. In this paper, a new view synthesis method to eliminate image artifacts is proposed. Firstly, a bidirectional mapping method is introduced to get the initial virtual image. Secondly, a confidence map is built over the initial image, in which pixels with low value are regarded as artifacts and marked as "hole". Finally, these "holes" are filled up by the proposed Hierarchical Completion of Hole (HCH) method. Experimental results show that good results can still be acquired even with the input depth maps containing a large number of wrong pixels.