Depth Super-resolution by Fusing Depth Imaging and Stereo Vision with Structural Determinant Information Inference

Yucheng Wang,Huijun Di,Bingjie Wang,Wei Liang,Jian Zhang,Yunde Jia
DOI: https://doi.org/10.1109/ICPR.2014.722
2014-01-01
Abstract:In this paper, we present a depth super-resolution framework by fusing depth imaging and stereo vision for high-resolution and high-accuracy depth maps. Depth cameras and stereo vision have their own limitations in some aspects, but their characteristics of range sensing are complementary. Thus, combining both approaches can produce more satisfactory results than either one. Unlike previous fusion methods, we initially taking the noisy depth observation from depth camera as prior information of scene structure. The prior information of scene structure is also utilized to infer structural determinant information, like depth discontinuity and occlusion, which is essential to improve the quality of depth map in the fusion process. In succession, the prior knowledge helps to overcome difficulties of intensity inconsistency in image observation from stereo vision component. Experimental results demonstrate effectiveness and accuracy of the proposed method.
What problem does this paper attempt to address?