Abstract:Consumer-level RGB-D cameras have been widely used for dense 3D reconstruction of scenes. Especially for textureless or non-lambertian surfaces, consumer RGB-D cameras can ensure completeness of the reconstructed models at a low cost. However, the reconstruction quality relies heavily on the accuracy of the depth sensors. Digital cameras are also used popularly for capturing high-resolution pictures to achieve high-quality dense reconstruction of the scenes, but cannot handle textureless or non-lambertian regions well due to the visual ambiguity problem. To ensure both completeness and accuracy of the reconstructed 3D models, we propose a hybrid multi-view reconstruction pipeline named Hybrid-MVS, which combines the high-resolution images taken by a digital camera and the low-resolution RGB-D frames captured by a consumer RGB-D camera for robust reconstruction of complicated scenes with challenging textureless and non-lambertian surfaces. Unlike most existing multi-sensor systems which require explicit hardware calibration and synchronization of various sensors, the calibration and synchronization problems between the digital camera and RGB-D camera are implicitly solved for compositing reliable depth prior of the digital images in our pipeline. Especially, we propose a hybrid MVS framework for robust PatchMatch stereo and Delaunay meshing, which tightly couples both visual cues given by the digital images and depth cues from the RGB-D frames to maximize the complementary advantages. The experiments with quantitative and qualitative evaluations demonstrate the effectiveness of the proposed Hybrid-MVS framework, which can successfully achieve high-quality 3D reconstruction of complicated natural scenes with robustness to weakly textured and non-lambertian areas.

Multiple Photo-Consistency Constraints for 3D Volumetric Reconstruction in Multi-View

A Convex Framework for High Resolution 3D Reconstruction.

3d Reconstruction With Multi-View Texture Mapping

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

Multi-view Stereo Reconstruction Via Voxel Clustering and Optimization of Parallel Volumetric Graph Cuts

An Active Volumetric Model for 3D Reconstruction

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

Multi-view Reconstruction under Varying Illumination Conditions

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

Accurate 3D reconstruction via surface-consistency

Multi-View Geometry Compression

2L3: Lifting Imperfect Generated 2D Images into Accurate 3D

Visual Odometry Based 3D-Reconstruction

VI3DRM:Towards meticulous 3D Reconstruction from Sparse Views via Photo-Realistic Novel View Synthesis

Hyperbolic-constraint Point Cloud Reconstruction from Single RGB-D Images

Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture

3-D Reconstruction of Image Sequence Based on Independent Three-View

A Coarse-to-Fine Transformer-Based Network for 3D Reconstruction from Non-Overlapping Multi-View Images

Multi-View Consistency Loss for Improved Single-Image 3D Reconstruction of Clothed People

Multi-View Reconstruction using Signed Ray Distance Functions (SRDF)

3D colored object reconstruction from a single view image through diffusion