Abstract:In this paper, we present a novel approach to imaging a panoramic (360°) environment and computing its dense depth map. Our approach adopts a multi-baseline stereo strategy using a set of multi-perspective panoramas where large baseline lengths are available. We design two image acquisition rigs for capturing such multi-perspective panoramas. The first one is composed of two parallel stereo cameras. By rotating the rig about a vertical axis, we generate four multi-perspective panoramas by resampling the regular perspective images captured by the stereo cameras. Then a depth map is estimated from the four multi-perspective panoramas and an original perspective image using a multi-baseline matching technique with different types of epipolar constraints. The second one is composed of a single camera and two mirrors. By rotating the rig, we acquire a spatio-temporal volume that is made up of the sequential images captured by the camera. Then we estimate a depth map by extracting trajectories from the spatio-temporal volume by using a multi-baseline stereo technique by considering occlusions. We can consider both rotating rigs as a single rotating camera with a very large field of view (FOV), that offers a large baseline length in depth estimation. In addition, compared with a previous approach using two multi-perspective panoramas from a single rotating camera, our approach can reduce matching errors due to image noise, repeated patterns, and occlusions by multi-baseline stereo techniques. Experimental results using both synthetic and real images show that our approach produces high quality panoramic 3D reconstruction.

Panoramic face and ear image stitching in multi-modal recognition

An Ellipse Detection Method for 3D Head Image Fusion Based on Color-Coded Mark Points

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization

An Efficient Approach of 3D Ear Recognition

3D Face Recognition using Mapped Depth Images

A Multi-resolution Based Image Registration Method for Panorama

Fast Panoramic Face Mosaicing and Recognition

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

An Improved 3D Shape Recognition Method Based on Panoramic View

3D Ear Recognition Using Local Salience and Principal Manifold

Panorama based on multi-channel-attention CNN for 3D model recognition

Robust 3D Face Recognition by Local Shape Difference Boosting

Panoramic Image Stitching Using Double Encoder–Decoders

Point CNN:3D Face Recognition with Local Feature Descriptor and Feature Enhancement Mechanism

A Multi-modal 2D + 3D Face Recognition Method with a Novel Local Feature Descriptor

Panoramic 3d Reconstruction Using Stereo Multi-Perspective Panorama

Omnidirectional 3D Reconstruction Using Stereo Multi-Perspective Panoramas

Deep Feature Extraction for Panoramic Image Stitching

Deep Spherical Panoramic Representation for 3D Shape Recognition

Exploring facial expression effects in 3d face recognition using partial ICP