Abstract:Technology for capturing panoramic (360 degrees) three-dimensional information in a real environment have many applications in fields: virtual and complex reality, security, robot navigation, and so forth. In this study, we examine an acquisition device constructed of a regular CCD camera and a 2D laser range scanner, along with a technique for panoramic 3D reconstruction using a data fusion algorithm based on an energy minimization framework. The acquisition device can capture two types of data of a panoramic scene without occlusion between two sensors: a dense spatio-temporal volume from a camera and distance information from a laser scanner. We resample the dense spatio-temporal volume for generating a dense multi-perspective panorama that has equal spatial resolution to that of the original images acquired using a regular camera, and also estimate a dense panoramic depth-map corresponding to the generated reference panorama by extracting trajectories from the dense spatio-temporal volume with a selecting camera. Moreover, for determining distance information robustly, we propose a data fusion algorithm that is embedded into an energy minimization framework that incorporates active depth measurements using a 2D laser range scanner and passive geometry reconstruction from an image sequence obtained using the CCD camera. Thereby, measurement precision and robustness can be improved beyond those available by conventional methods using either passive geometry reconstruction (stereo vision) or a laser range scanner. Experimental results using both synthetic and actual images show that our approach can produce high-quality panoramas and perform accurate 3D reconstruction in a panoramic environment.

Panoramic 3D Reconstruction Using Rotational Stereo Camera with Simple Epipolar Constraints

Panoramic 3d Reconstruction Using Stereo Multi-Perspective Panorama

Omnidirectional 3D Reconstruction Using Stereo Multi-Perspective Panoramas

Panoramic 3 D Reconstruction Using Rotating Camera with Planar Mirrors

A Simple 3D Reconstruction Method Based on Single Camera

Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

Unwrapping and Stereo Rectification for Omnidirectional Images

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

Design of Panoramic Stereo Imaging with Single Optical System

Panoramic Imaging and 3D Reconstruction Based on Sparse Image Volume

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

Omni-directional Image Unwarping Based on Taylor Model

Panoramic Stereo Imaging Using Hyperboloid Catadioptric Cameras

An Event-Driven Stereo System for Real-Time 3-D 360° Panoramic Vision

Asymmetric representation for 3D panoramic video

Panoramic epipolar analysis for 3D scene modeling

Noise-Resilient Reconstruction of Panoramas and 3D Scenes Using Robot-Mounted Unsynchronized Commodity RGB-D Cameras

Measurable Panorama Construction Based on Binocular Spherical Projective Geometry

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

PanoDreamer: 3D Panorama Synthesis from a Single Image

Panoramic 3D Reconstruction by Fusing Color Intensity and Laser Range Data