Abstract:Consumer-level RGB-D cameras have been widely used for dense 3D reconstruction of scenes. Especially for textureless or non-lambertian surfaces, consumer RGB-D cameras can ensure completeness of the reconstructed models at a low cost. However, the reconstruction quality relies heavily on the accuracy of the depth sensors. Digital cameras are also used popularly for capturing high-resolution pictures to achieve high-quality dense reconstruction of the scenes, but cannot handle textureless or non-lambertian regions well due to the visual ambiguity problem. To ensure both completeness and accuracy of the reconstructed 3D models, we propose a hybrid multi-view reconstruction pipeline named Hybrid-MVS, which combines the high-resolution images taken by a digital camera and the low-resolution RGB-D frames captured by a consumer RGB-D camera for robust reconstruction of complicated scenes with challenging textureless and non-lambertian surfaces. Unlike most existing multi-sensor systems which require explicit hardware calibration and synchronization of various sensors, the calibration and synchronization problems between the digital camera and RGB-D camera are implicitly solved for compositing reliable depth prior of the digital images in our pipeline. Especially, we propose a hybrid MVS framework for robust PatchMatch stereo and Delaunay meshing, which tightly couples both visual cues given by the digital images and depth cues from the RGB-D frames to maximize the complementary advantages. The experiments with quantitative and qualitative evaluations demonstrate the effectiveness of the proposed Hybrid-MVS framework, which can successfully achieve high-quality 3D reconstruction of complicated natural scenes with robustness to weakly textured and non-lambertian areas.

A 3D Reconstruction Method with Color Reproduction from Multi-band and Multi-view Images

Robust 3D Reconstruction with an RGB-D Camera

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Visual Odometry Based 3D-Reconstruction

3d Reconstruction With Multi-View Texture Mapping

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

Efficient 3D reconstruction for urban scenes

A Method of Rapid Interactive 3D Reconstruction from Sequence Image

Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture

Accurate and Efficient 3D Reconstruction System for the Human Body with Color Texture Based on DIC

An Improved Algorithm for 3D Reconstruction Based on Color CGHs of 3D Objects Using Multiple Projection View Images

3d Reconstruction Of Space Objects From Multi-Views By A Visible Sensor

3D Scene Reconstruction from Multi-Aperture Images

IMPROVING PERFORMANCE OF FEATURE EXTRACTION IN SFM ALGORITHMS FOR 3D SPARSE POINT CLOUD

VI3DRM:Towards meticulous 3D Reconstruction from Sparse Views via Photo-Realistic Novel View Synthesis

Data-Driven 3D Reconstruction of Dressed Humans From Sparse Views

A 3d Reconstruction System For Large Scene Based On Rgb-D Image

ReFu: Refine and Fuse the Unobserved View for Detail-Preserving Single-Image 3D Human Reconstruction

3D Reconstruction with Spherical Cameras

Quick Capture and Reconstruction for 3D Head

Research on Multi-View 3D Reconstruction Technology Based on SFM