Abstract:Reconstruction of a continuous surface of two-dimensional manifold from its raw, discrete point cloud observation is a long-standing problem in computer vision and graphics research. The problem is technically ill-posed, and becomes more difficult considering that various sensing imperfections would appear in the point clouds obtained by practical depth scanning. In literature, a rich set of methods has been proposed, and reviews of existing methods are also provided. However, existing reviews are short of thorough investigations on a common benchmark. The present paper aims to review and benchmark existing methods in the new era of deep learning surface reconstruction. To this end, we contribute a large-scale benchmarking dataset consisting of both synthetic and real-scanned data; the benchmark includes object- and scene-level surfaces and takes into account various sensing imperfections that are commonly encountered in practical depth scanning. We conduct thorough empirical studies by comparing existing methods on the constructed benchmark, and pay special attention on robustness of existing methods against various scanning imperfections; we also study how different methods generalize in terms of reconstructing complex surface shapes. Our studies help identity the best conditions under which different methods work, and suggest some empirical findings. For example, while deep learning methods are increasingly popular in the research community, our systematic studies suggest that, surprisingly, a few classical methods perform even better in terms of both robustness and generalization; our studies also suggest that the practical challenges of misalignment of point sets from multi-view scanning, missing of surface points, and point outliers remain unsolved by all the existing surface reconstruction methods. We expect that the benchmark and our studies would be valuable both for practitioners and as a guidance for new innovations in future research. We make the benchmark publicly accessible at https://Gorilla-Lab-SCUT.github.io/SurfaceReconstructionBenchmark.

Deep Surface Reconstruction from Point Clouds with Visibility Information

A Survey and Benchmark of Automatic Surface Reconstruction from Point Clouds

Scalable Surface Reconstruction with Delaunay‐Graph Neural Networks

High-Fidelity Mask-free Neural Surface Reconstruction for Virtual Reality

Deep-Learning-Based 3-D Surface Reconstruction—A Survey

Neural-IMLS: Self-supervised Implicit Moving Least-Squares Network for Surface Reconstruction

Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors

3D Surface Reconstruction in the Wild by Deforming Shape Priors from Synthetic Data

Deep Point Cloud Reconstruction

Automated Reconstruction of 3D Open Surfaces from Sparse Point Clouds

Depth Supervised Neural Surface Reconstruction from Airborne Imagery

Surface Reconstruction from Point Clouds: A Survey and a Benchmark

NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wild

Neural Surface Reconstruction and Rendering for LiDAR-Visual Systems

NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction

High-Resolution and Efficient Neural Dual Contouring for Surface Reconstruction from Point Clouds

NSLF-OL: Online Learning of Neural Surface Light Fields alongside Real-time Incremental 3D Reconstruction

ReTR: Modeling Rendering Via Transformer for Generalizable Neural Surface Reconstruction

Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimization

POCO: Point Convolution for Surface Reconstruction

UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction