Abstract:In this paper, we propose a novel approach for obtaining 3D information of panoramic (360 degrees) environments. We design an image acquisition rig composed with a camera and two planar mirrors. The regular image captured by the camera is separated into uncontinuous three regions by the mirrors arranged in front of the camera. By rotating the rig about a vertical axis with a constant velocity, we acquire a sampled spaciotemporal volume which is made of the sequential images captured by a uniform angular interval. We estimate a panoramic depth map, which has the same density (spatial resolution) as the regular images, by extracting trajectories of 3D points from the uniformly sampled spacio-temporal volume using a multibaseline stereo technique with considering occlusions. Our approach can be considered as stereo reconstruction from a large number of multiperspective panoramas acquired by three rotating cameras. Compared with a previous approach using two multiperspective panoramas from a single rotating camera, our approach has advantages as follows: A large baseline length is available; Matching errors due to image noise, repeated patterns, and occlusions are reduced by the multibaseline stereo technique; We use a certain amount of the angular interval for fast image accumulation, instead of a small interval required in the previous approach for dense depth estimation. Additionally, our approach is available as an image mosaicing technique to create dense multiperspective panoramas. Experimental results using both synthetic and real images show that our approach produces high quality panoramic 3D reconstruction.

Omnidirectional ghost imaging system and unwrapping-free panoramic ghost imaging

Multidirectional Edge Detection Based on Gradient Ghost Imaging

Unwrapping and Stereo Rectification for Omnidirectional Images

Foveated panoramic ghost imaging

Design of Panoramic Stereo Imaging with Single Optical System

Design of a single-sensor gazing panoramic stereo imaging system with no central blind area

Omni-directional Image Unwarping Based on Taylor Model

Improving the Quality of Panoramic Ghost Imaging Via Rotation and Scaling Invariances

High-speed Ghost Imaging by an Unpredictable Optical Phased Array

Research on high resolution & high sensitivity panoramic surveillance system

Polarimetric ghost imaging.

Design and Realization of Multi-viewpoint Catadioptric Omnidirectional Imaging System

Omnidirectional 3D Reconstruction Using Rotating Camera with Mirrors

Reconnaissance Technology about Reflective Panoramic Vision for Unmanned Platform

Parallel computational ghost imaging with modulation patterns multiplexing and permutation inspired by compound eyes

Multi-resolution Progressive Computational Ghost Imaging

A Review of Ghost Imaging via Sparsity Constraints

Three-dimensional ghost imaging based on differential optical path

Panoramic 3 D Reconstruction Using Rotating Camera with Planar Mirrors

Self-corrected orthonormalized ghost imaging through dynamic and complex scattering media

Omnidirectional Image Super-resolution Via Bi-projection Fusion