Panoramic 3 D Reconstruction Using Rotating Camera with Planar Mirrors

Jiang Wei,Shigeki Sugimoto,Masatoshi Okutomi

2005-01-01

Abstract:In this paper, we propose a novel approach for obtaining 3D information of panoramic (360 degrees) environments. We design an image acquisition rig composed with a camera and two planar mirrors. The regular image captured by the camera is separated into uncontinuous three regions by the mirrors arranged in front of the camera. By rotating the rig about a vertical axis with a constant velocity, we acquire a sampled spaciotemporal volume which is made of the sequential images captured by a uniform angular interval. We estimate a panoramic depth map, which has the same density (spatial resolution) as the regular images, by extracting trajectories of 3D points from the uniformly sampled spacio-temporal volume using a multibaseline stereo technique with considering occlusions. Our approach can be considered as stereo reconstruction from a large number of multiperspective panoramas acquired by three rotating cameras. Compared with a previous approach using two multiperspective panoramas from a single rotating camera, our approach has advantages as follows: A large baseline length is available; Matching errors due to image noise, repeated patterns, and occlusions are reduced by the multibaseline stereo technique; We use a certain amount of the angular interval for fast image accumulation, instead of a small interval required in the previous approach for dense depth estimation. Additionally, our approach is available as an image mosaicing technique to create dense multiperspective panoramas. Experimental results using both synthetic and real images show that our approach produces high quality panoramic 3D reconstruction.