Abstract:Reconstruction of a continuous surface of two-dimensional manifold from its raw, discrete point cloud observation is a long-standing problem in computer vision and graphics research. The problem is technically ill-posed, and becomes more difficult considering that various sensing imperfections would appear in the point clouds obtained by practical depth scanning. In literature, a rich set of methods has been proposed, and reviews of existing methods are also provided. However, existing reviews are short of thorough investigations on a common benchmark. The present paper aims to review and benchmark existing methods in the new era of deep learning surface reconstruction. To this end, we contribute a large-scale benchmarking dataset consisting of both synthetic and real-scanned data; the benchmark includes object- and scene-level surfaces and takes into account various sensing imperfections that are commonly encountered in practical depth scanning. We conduct thorough empirical studies by comparing existing methods on the constructed benchmark, and pay special attention on robustness of existing methods against various scanning imperfections; we also study how different methods generalize in terms of reconstructing complex surface shapes. Our studies help identity the best conditions under which different methods work, and suggest some empirical findings. For example, while deep learning methods are increasingly popular in the research community, our systematic studies suggest that, surprisingly, a few classical methods perform even better in terms of both robustness and generalization; our studies also suggest that the practical challenges of misalignment of point sets from multi-view scanning, missing of surface points, and point outliers remain unsolved by all the existing surface reconstruction methods. We expect that the benchmark and our studies would be valuable both for practitioners and as a guidance for new innovations in future research. We make the benchmark publicly accessible at https://Gorilla-Lab-SCUT.github.io/SurfaceReconstructionBenchmark.

Surface Reconstruction from Point Clouds via Grid-based Intersection Prediction

Surface Extraction and Boundary Detection Based on DBSCAN Clustering in 3D Point Clouds

3D Surface Segmentation from Point Clouds Via Quadric Fits Based on DBSCAN Clustering

Parametric Surfaces Intersection Algorithm Based on Discrete Surfels

A Fast Progressive Surface Reconstruction Algorithm for Unorganized Points

GridFormer: Point-Grid Transformer for Surface Reconstruction

A Survey and Benchmark of Automatic Surface Reconstruction from Point Clouds

Surface Reconstruction from Point Clouds: A Survey and a Benchmark

A Novel Surface Reconstruction Framework from Point Clouds Without Normal

Multi-grid Representation with Field Regularization for Self-Supervised Surface Reconstruction from Point Clouds

MuSic-UDF: Learning Multi-Scale dynamic grid representation for high-fidelity surface reconstruction from point clouds

Learning Unsigned Distance Fields from Local Shape Functions for 3D Surface Reconstruction

Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors

Surface Reconstruction Pattern Recognition Technology Based on Scattered Point Cloud Data

A Survey of Surface Reconstruction from Point Clouds

A New Approach to 3D Object Surface Reconstruction from Unorganized Points

HSDF: Hybrid Sign and Distance Field for Neural Representation of Surfaces with Arbitrary Topologies

Point Scene Understanding Via Disentangled Instance Mesh Reconstruction

Surface Reconstruction Technology from Dense Scattered Points Based on Grid

A surface reconstruction method for highly noisy point clouds

Deep Surface Reconstruction from Point Clouds with Visibility Information