Abstract:Technology for capturing panoramic (360 degrees) three-dimensional information in a real environment have many applications in fields: virtual and complex reality, security, robot navigation, and so forth. In this study, we examine an acquisition device constructed of a regular CCD camera and a 2D laser range scanner, along with a technique for panoramic 3D reconstruction using a data fusion algorithm based on an energy minimization framework. The acquisition device can capture two types of data of a panoramic scene without occlusion between two sensors: a dense spatio-temporal volume from a camera and distance information from a laser scanner. We resample the dense spatio-temporal volume for generating a dense multi-perspective panorama that has equal spatial resolution to that of the original images acquired using a regular camera, and also estimate a dense panoramic depth-map corresponding to the generated reference panorama by extracting trajectories from the dense spatio-temporal volume with a selecting camera. Moreover, for determining distance information robustly, we propose a data fusion algorithm that is embedded into an energy minimization framework that incorporates active depth measurements using a 2D laser range scanner and passive geometry reconstruction from an image sequence obtained using the CCD camera. Thereby, measurement precision and robustness can be improved beyond those available by conventional methods using either passive geometry reconstruction (stereo vision) or a laser range scanner. Experimental results using both synthetic and actual images show that our approach can produce high-quality panoramas and perform accurate 3D reconstruction in a panoramic environment.

Three-dimensional Panoramic Sensor Based on a Variable-Frequency Fringe Pattern.

3D Framing Camera System Based on Sample Cumulation Method

A Design Method of the Distortionless Catadioptric Panoramic Imaging Based on Freeform Surface

Panoramic Three-Dimensional Optical Digitization System Assisted by a Bi-Mirror.

A 360-Degree Panoramic Stereo Scanning Measurement System Based on a Panoramic Annular Lens and Omnidirectional Ring Structured Light

A Present and Development of Catadioptric Panoramic Stereo Imaging Technique

Design of High Resolution Panoramic Annular Lens System

Design of Panoramic Stereo Imaging with Single Optical System

Design of a Panoramic Annular Lens System with an Ultra-Wide Angle Via an Annular Gaussian Radial Basis Function Freeform Surface.

Research on Image Processing of Two-Dimensional Plan of the Hemispheric Panoramic Imaging System

Design of a single-sensor gazing panoramic stereo imaging system with no central blind area

Mathematical Modeling and Implementation of a Panoramic Zoom System Without Central Blind Area

Research on Multispectral 3D Panoramic Vision Device

High-speed 360° 3D shape measurement based on virtual stereo phase unwrapping method

High-speed 360 3D shape measurement based on visual stereo phase unwrapping method

Panoramic Optical Annular Staring Imaging Technology

An Omnidirectional 3D Sensor with Line Laser Scanning

3D Multi-Directional Sensor with Pyramid Mirror and Structured Light

Variable Aperture Panoramic Imaging

Dynamically Tunable Hemispherical Electronic Eye Camera System with Adjustable Zoom Capability

Panoramic 3D Reconstruction by Fusing Color Intensity and Laser Range Data