Multi-view coding for image-based rendering using 3-d scene geometry

Marcus Magnor,Prashant Ramanathan,Bernd Girod,M. Magnor,P. Ramanathan,B. Girod
DOI: https://doi.org/10.1109/tcsvt.2003.817630
IF: 5.859
2003-11-01
IEEE Transactions on Circuits and Systems for Video Technology
Abstract:To store and transmit the large amount of image data necessary for Image-based Rendering (IBR), efficient coding schemes are required. This paper presents two different approaches which exploit three–dimensional scene geometry for multi-view compression. In texture-based coding, images are converted to view-dependent texture maps for compression. In model-aided predictive coding, scene geometry is used for disparity compensation and occlusion detection between images. While both coding strategies are able to attain compression ratios exceeding 2000:1, individual coding performance is found to depend on the accuracy of the available geometry model. Experiments with real-world as well as synthetic image sets show that texture-based coding is more sensitive to geometry inaccuracies than predictive coding. A rate-distortion theoretical analysis of both schemes supports these findings. For reconstructed approximate geometry models, model-aided predictive coding performs best, while texture-based coding yields superior coding results if scene geometry is exactly known.
engineering, electrical & electronic
What problem does this paper attempt to address?