Rendering by Manifold Hopping

Heung-Yeung Shum,Lifeng Wang,Jin-Xiang Chai,Xin Tong
DOI: https://doi.org/10.1023/A:1020398016678
IF: 13.369
2002-01-01
International Journal of Computer Vision
Abstract:In this paper, we present a novel image-based rendering technique, which we call manifold hopping . Our technique provides users with perceptually continuous navigation by using only a small number of strategically sampled manifold mosaics or multiperspective panoramas. Manifold hopping has two modes of navigation: moving continuously along any manifold, and discretely between manifolds. An important feature of manifold hopping is that significant data reduction can be achieved without sacrificing output visual fidelity, by carefully adjusting the hopping intervals. A novel view along the manifold is rendered by locally warping a single manifold mosaic using a constant depth assumption, without the need for accurate depth or feature correspondence. The rendering errors caused by manifold hopping can be analyzed in the signed Hough ray space. Experiments with real data demonstrate that we can navigate smoothly in a virtual environment with as little as 88 k data compressed from 11 concentric mosaics.
What problem does this paper attempt to address?