Abstract:Surface reconstruction has traditionally relied on the Multi-View Stereo (MVS)-based pipeline, which often suffers from noisy and incomplete geometry. This is due to that although MVS has been proven to be an effective way to recover the geometry of the scenes, especially for locally detailed areas with rich textures, it struggles to deal with areas with low texture and large variations of illumination where the photometric consistency is unreliable. Recently, Neural Implicit Surface Reconstruction (NISR) combines surface rendering and volume rendering techniques and bypasses the MVS as an intermediate step, which has emerged as a promising alternative to overcome the limitations of traditional pipelines. While NISR has shown impressive results on simple scenes, it remains challenging to recover delicate geometry from uncontrolled real-world scenes which is caused by its underconstrained optimization. To this end, the framework PSDF is proposed which resorts to external geometric priors from a pretrained MVS network and internal geometric priors inherent in the NISR model to facilitate high-quality neural implicit surface learning. Specifically, the visibility-aware feature consistency loss and depth prior-assisted sampling based on external geometric priors are introduced. These proposals provide powerfully geometric consistency constraints and aid in locating surface intersection points, thereby significantly improving the accuracy and delicate reconstruction of NISR. Meanwhile, the internal prior-guided importance rendering is presented to enhance the fidelity of the reconstructed surface mesh by mitigating the biased rendering issue in NISR. Extensive experiments on the Tanks and Temples dataset show that PSDF achieves state-of-the-art performance on complex uncontrolled scenes.

ParaSurRe: Parallel Surface Reconstruction with No Pose Prior

MD-Surf: Multimodal Neural Surface Reconstruction from Driving Views

Sur2f: A Hybrid Representation for High-Quality and Efficient Surface Reconstruction from Multi-view Images

Prior surface model guided dense reconstruction via graph-cuts

NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Views

Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstruction

Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstruction

PSDF: Prior-Driven Neural Implicit Surface Learning for Multi-view Reconstruction

PR-NeuS: A Prior-based Residual Learning Paradigm for Fast Multi-view Neural Surface Reconstruction

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy Views

StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Views

CoSurfGS:Collaborative 3D Surface Gaussian Splatting with Distributed Learning for Large Scene Reconstruction

Highly Parallel Surface Reconstruction

Surfel-Based Dense Rgb-D Reconstruction With Global And Local Consistency

Progressive surface reconstruction from images using a local prior

GSurf: 3D Reconstruction via Signed Distance Fields with Direct Gaussian Supervision

C2F2NeUS: Cascade Cost Frustum Fusion for High Fidelity and Generalizable Neural Surface Reconstruction

PVP-Recon: Progressive View Planning Via Warping Consistency for Sparse-View Surface Reconstruction

Multi-view Stereo Reconstruction Via Voxel Clustering and Optimization of Parallel Volumetric Graph Cuts

Res-NeuS: Deep Residuals and Neural Implicit Surface Learning for Multi-View Reconstruction