A Temporally Streamlined Optimization Method for Stereo Video Correspondence

Li Yao -,DongXiao Li -,Ming Zhang -
DOI: https://doi.org/10.4156/ijact.vol4.issue2.29
2012-01-01
International Journal of Advancements in Computing Technology
Abstract:Multi-view plus associated depth information form a typical 3D video representation, in which the depth is usually a result of estimation procedure based on stereo correspondence. Traditional stereo correspondence methods deal with each stereo image pair separately. As a result, the depth sequence is temporally inconsistent. This paper presents a novel method to reconstruct spatio-temporally consistent depth maps. We formulate the stereo problem on 3D Markov random fields to exploit correlation in both spatial and temporal domain. Then a sequential belief propagation algorithm is applied for minimizing the global energy and temporal consistency is enforced during the process. In addition, our streamlined implementation is time and memory efficient. We perform quantitative evaluation as well as subject assessment on several test datasets, which shows that our method yields temporally consistent depth sequence and reduces flickering artifacts in the synthesized view while maintaining visual quality.
What problem does this paper attempt to address?