Abstract:Consumer-level RGB-D cameras have been widely used for dense 3D reconstruction of scenes. Especially for textureless or non-lambertian surfaces, consumer RGB-D cameras can ensure completeness of the reconstructed models at a low cost. However, the reconstruction quality relies heavily on the accuracy of the depth sensors. Digital cameras are also used popularly for capturing high-resolution pictures to achieve high-quality dense reconstruction of the scenes, but cannot handle textureless or non-lambertian regions well due to the visual ambiguity problem. To ensure both completeness and accuracy of the reconstructed 3D models, we propose a hybrid multi-view reconstruction pipeline named Hybrid-MVS, which combines the high-resolution images taken by a digital camera and the low-resolution RGB-D frames captured by a consumer RGB-D camera for robust reconstruction of complicated scenes with challenging textureless and non-lambertian surfaces. Unlike most existing multi-sensor systems which require explicit hardware calibration and synchronization of various sensors, the calibration and synchronization problems between the digital camera and RGB-D camera are implicitly solved for compositing reliable depth prior of the digital images in our pipeline. Especially, we propose a hybrid MVS framework for robust PatchMatch stereo and Delaunay meshing, which tightly couples both visual cues given by the digital images and depth cues from the RGB-D frames to maximize the complementary advantages. The experiments with quantitative and qualitative evaluations demonstrate the effectiveness of the proposed Hybrid-MVS framework, which can successfully achieve high-quality 3D reconstruction of complicated natural scenes with robustness to weakly textured and non-lambertian areas.

The Chameleon-Like Vision System

Intelligent Driver Assistance System Based on Panoramic Video Technique

A Method of Video Analysis in Vehicle Based on A Single Pal Camera

Capture Of Vehicle Surroundings Using A Pair Of Panoramic Annular Lens Cameras

Multi-Camera System: Imaging Enhancement and Application

Stereo Vision Using Two PTZ Cameras

A Master-slave Tracking Algorithm Using Two PTZ Cameras

Multiresolution and wide-scope depth estimation using a dual-PTZ-camera system.

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Research of real-time wide field image merging based on multi-cameras

A master-slave system for intelligent visual surveillance

A Security System Based on Remote Iris Recognition

Anatomy of a Multicamera Video Surveillance System

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

Active Perception with A Monocular Camera for Multiscopic Vision

Research on Design, Calibration and Real-Time Image Expansion Technology of Unmanned System Variable-Scale Panoramic Vision System

High resolution multispectral video capture with a hybrid camera system

Multi-CAMSHIFT for Multi-View Faces Tracking and Recognition

Automated monitoring for security camera networks: promise from computer vision labs

Acquisition of High Spatial and Spectral Resolution Video with a Hybrid Camera System

Vision System of Mobile Robot Combining Binocular and Depth Cameras