Abstract:Consumer-level RGB-D cameras have been widely used for dense 3D reconstruction of scenes. Especially for textureless or non-lambertian surfaces, consumer RGB-D cameras can ensure completeness of the reconstructed models at a low cost. However, the reconstruction quality relies heavily on the accuracy of the depth sensors. Digital cameras are also used popularly for capturing high-resolution pictures to achieve high-quality dense reconstruction of the scenes, but cannot handle textureless or non-lambertian regions well due to the visual ambiguity problem. To ensure both completeness and accuracy of the reconstructed 3D models, we propose a hybrid multi-view reconstruction pipeline named Hybrid-MVS, which combines the high-resolution images taken by a digital camera and the low-resolution RGB-D frames captured by a consumer RGB-D camera for robust reconstruction of complicated scenes with challenging textureless and non-lambertian surfaces. Unlike most existing multi-sensor systems which require explicit hardware calibration and synchronization of various sensors, the calibration and synchronization problems between the digital camera and RGB-D camera are implicitly solved for compositing reliable depth prior of the digital images in our pipeline. Especially, we propose a hybrid MVS framework for robust PatchMatch stereo and Delaunay meshing, which tightly couples both visual cues given by the digital images and depth cues from the RGB-D frames to maximize the complementary advantages. The experiments with quantitative and qualitative evaluations demonstrate the effectiveness of the proposed Hybrid-MVS framework, which can successfully achieve high-quality 3D reconstruction of complicated natural scenes with robustness to weakly textured and non-lambertian areas.

Self-Supervised 3d Face Reconstruction Based On Multi-View Uv Fusion

Multi-view self-supervised learning for 3D facial texture reconstruction from single image

Monocular 3D Face Reconstruction with Joint 2D and 3D Constraints

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

3d Reconstruction With Multi-View Texture Mapping

From 2D Images to 3D Model:Weakly Supervised Multi-View Face Reconstruction with Deep Fusion

3D3M: 3D Modulated Morphable Model for Monocular Face Reconstruction

Monocular face reconstruction with global and local shape constraints.

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

Coarse-to-fine Multiview 3d Face Reconstruction Using Multiple Geometrical Features.

Weakly-Supervised Multi-Face 3D Reconstruction

Adaptive 3D Face Reconstruction from a Single Image

Self-adaptive Morphable Model Based Multi-View Non-Cooperative 3D Face Reconstruction

View Consistent 3D Face Reconstruction Using Siamese Encoder-Decoders

Visibility-guided Human Body Reconstruction from Uncalibrated Multi-view Cameras

3D Face Reconstruction with Geometry Details from a Single Image

3D face reconstruction from mugshots: Application to arbitrary view face recognition

Realistic 3D Face Modeling by Fusing Multiple 2D Images

Self-supervised single-image 3D face reconstruction method based on attention mechanism and attribute refinement

Semi-supervised Single-view 3D Reconstruction via Multi Shape Prior Fusion Strategy and Self-Attention

Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set