Abstract:Consumer-level RGB-D cameras have been widely used for dense 3D reconstruction of scenes. Especially for textureless or non-lambertian surfaces, consumer RGB-D cameras can ensure completeness of the reconstructed models at a low cost. However, the reconstruction quality relies heavily on the accuracy of the depth sensors. Digital cameras are also used popularly for capturing high-resolution pictures to achieve high-quality dense reconstruction of the scenes, but cannot handle textureless or non-lambertian regions well due to the visual ambiguity problem. To ensure both completeness and accuracy of the reconstructed 3D models, we propose a hybrid multi-view reconstruction pipeline named Hybrid-MVS, which combines the high-resolution images taken by a digital camera and the low-resolution RGB-D frames captured by a consumer RGB-D camera for robust reconstruction of complicated scenes with challenging textureless and non-lambertian surfaces. Unlike most existing multi-sensor systems which require explicit hardware calibration and synchronization of various sensors, the calibration and synchronization problems between the digital camera and RGB-D camera are implicitly solved for compositing reliable depth prior of the digital images in our pipeline. Especially, we propose a hybrid MVS framework for robust PatchMatch stereo and Delaunay meshing, which tightly couples both visual cues given by the digital images and depth cues from the RGB-D frames to maximize the complementary advantages. The experiments with quantitative and qualitative evaluations demonstrate the effectiveness of the proposed Hybrid-MVS framework, which can successfully achieve high-quality 3D reconstruction of complicated natural scenes with robustness to weakly textured and non-lambertian areas.

High Fidelity Aggregated Planar Prior Assisted PatchMatch Multi-View Stereo

HQP-MVS:High-Quality Plane Priors Assisted Multi-View Stereo for Low-Textured Areas

PM-PM: PatchMatch with Potts Model for Object Segmentation and Stereo Matching.

Prior surface model guided dense reconstruction via graph-cuts

A Submap Joining Algorithm for 3D Reconstruction Using an RGB-D Camera Based on Point and Plane Features

MP-MVS: Multi-Scale Windows PatchMatch and Planar Prior Multi-View Stereo

CNLPA-MVS: Coarse-Hypotheses Guided Non-Local PatchMatch Multi-View Stereo

Multi-View Depth Estimation with Color-Aware Propagation and Texture-Aware Triangulation

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

A Semi-Supervised Method for PatchMatch Multi-View Stereo with Sparse Points

Confidence-Guided Planar-Recovering Multiview Stereo for Weakly Textured Plane of High-Resolution Image Scenes

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

Segmentation-aware Prior Assisted Joint Global Information Aggregated 3D Building Reconstruction

High-Quality Depth Recovery Via Interactive Multi-view Stereo

3d Reconstruction With Multi-View Texture Mapping

MSP-MVS: Multi-granularity Segmentation Prior Guided Multi-View Stereo

Multi-View Stereo Representation Revist: Region-Aware MVSNet

MVP-Stereo: A Parallel Multi-View Patchmatch Stereo Method with Dilation Matching for Photogrammetric Application

PlaneStereo: Plane-aware Multi-view Stereo

Efficient 3D Reconstruction Through Enhanced PatchMatch Techniques for Accelerated Point Cloud Generation

High completeness multi-view stereo for dense reconstruction of large-scale urban scenes