Abstract:Multi-view 3D reconstruction generally adopts the feature fusion strategy to guide the generation of 3D shape for objects with different views. Empirically, the correspondence learning of object regions across different views enables better feature fusion. However, such idea has not been fully exploited in existing methods. Furthermore, current methods fail to explore the intrinsic dependency among regions within a 3D shape, leading to a rough reconstruction result. To address the above issues, we propose a Dual-View 3D Point Cloud reconstruction architecture named DVPC, which takes two views images as inputs, and progressively generates a refined 3D point cloud. First, a point cloud generation network is assigned to generate a coarse point cloud for each input view. Second, a dual-view point clouds synthesis network is presented in DVPC. It constructs a regional attention mechanism to learn a high-quality correspondence among regions across two coarse point clouds in different views, so that our DVPC can achieve feature fusion accurately. And then it develops a point cloud deformation module to produce a relatively-precise point cloud via establishing the communication between the coarse point cloud and the fused feature. Lastly, a point-region transformer network is devised to model the dependency among regions within the relatively-precise point cloud. With the dependency, the relatively-precise point cloud is refined into a desirable 3D point cloud with rich details. Qualitative and quantitative experiments on the ShapeNet and Pix3D datasets demonstrate that the proposed DVPC outperforms the state-of-the-art methods in terms of reconstruction quality.

Single-view 3D Reconstruction Algorithm Based on View-aware

View-Aware Geometry-Structure Joint Learning for Single-View 3D Shape Reconstruction

3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction

Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture

3D Reconstruction for Multi-view Objects

A Coarse-to-Fine Transformer-Based Network for 3D Reconstruction from Non-Overlapping Multi-View Images

DV-Net: Dual-view Network for 3D Reconstruction by Fusing Multiple Sets of Gated Control Point Clouds

Single-view 3D Mesh Reconstruction for Seen and Unseen Categories

What Do Single-view 3D Reconstruction Networks Learn?

Multi-view 3D Reconstruction from Video with Transformer.

Enhanced multi view 3D reconstruction with improved MVSNet

Attention Aware Cost Volume Pyramid Based Multi-view Stereo Network for 3D Reconstruction

Deep Single-View 3D Object Reconstruction with Visual Hull Embedding

2L3: Lifting Imperfect Generated 2D Images into Accurate 3D

Dual-View 3D Reconstruction via Learning Correspondence and Dependency of Point Cloud Regions

GARNet: Global-Aware Multi-View 3D Reconstruction Network and the Cost-Performance Tradeoff

Conditional Single-View Shape Generation for Multi-View Stereo Reconstruction.

ARShape-Net: Single-View Image Oriented 3D Shape Reconstruction with an Adversarial Refiner

Multi-view 3D Object Reconstruction and Uncertainty Modelling with Neural Shape Prior

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

Video Supervised for 3D Reconstruction from Single Image