Abstract:--A new approach to computing a panoramic (360 degrees) depth map is presented in this paper. Our approach uses a large collection of images taken by a camera whose motion has been constrained to planar concentric circles. We resample regular perspective images to produce a set of multiperspective panoramas and then compute depth maps directly from these resampled panoramas. Our panoramas sample uniformly in three dimensions: rotation angle, inverse radial distance, and vertical elevation. The use of multiperspective panoramas eliminates the limited overlap present in the original input images and, thus, problems as in conventional multibaseline stereo can be avoided. Our approach differs from stereo matching of single-perspective panoramic images taken from different locations, where the epipolar constraints are sine curves. For our multiperspective panoramas, the epipolar geometry, to the first order approximation, consists of horizontal lines. Therefore, any traditional stereo algorithm can be applied to multiperspective panoramas with little modification. In this paper, we describe two reconstruction algorithms. The first is a cylinder sweep algorithm that uses a small number of resampled multiperspective panoramas to obtain dense 3D reconstruction. The second algorithm, in contrast, uses a large number of multiperspective panoramas and takes advantage of the approximate horizontal epipolar geometry inherent in multiperspective panoramas. It comprises a novel and efficient 1D multibaseline matching technique, followed by tensor voting to extract the depth surface. Experiments show that our algorithms are capable of producing comparable high quality depth maps which can be used for applications such as view interpolation.

Panoramic 3d Reconstruction Using Stereo Multi-Perspective Panorama

Panoramic 3 D Reconstruction Using Rotating Camera with Planar Mirrors

Omnidirectional 3D Reconstruction Using Stereo Multi-Perspective Panoramas

Panoramic 3D Reconstruction Using Rotational Stereo Camera with Simple Epipolar Constraints

Stereo Reconstruction from Multiperspective Panoramas

Panoramic Imaging and 3D Reconstruction Based on Sparse Image Volume

Design of Panoramic Stereo Imaging with Single Optical System

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

An Event-Driven Stereo System for Real-Time 3-D 360° Panoramic Vision

Panoramic 3D Reconstruction by Fusing Color Intensity and Laser Range Data

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

Panoramic Stereo Imaging Using Hyperboloid Catadioptric Cameras

PanoDreamer: 3D Panorama Synthesis from a Single Image

MCPDepth: Omnidirectional Depth Estimation via Stereo Matching from Multi-Cylindrical Panoramas

Noise-Resilient Reconstruction of Panoramas and 3D Scenes Using Robot-Mounted Unsynchronized Commodity RGB-D Cameras

PanoDepth: A Two-Stage Approach for Monocular Omnidirectional Depth Estimation

DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization

Measurable Panorama Construction Based on Binocular Spherical Projective Geometry

Event-driven stereo matching for real-time 3D panoramic vision

Omnidirectional 3D Reconstruction Using Rotating Camera with Mirrors

A Method of 3D-Gis Application Aided with Stereo Panorama Technology