Abstract:Reconstruction of a continuous surface of two-dimensional manifold from its raw, discrete point cloud observation is a long-standing problem in computer vision and graphics research. The problem is technically ill-posed, and becomes more difficult considering that various sensing imperfections would appear in the point clouds obtained by practical depth scanning. In literature, a rich set of methods has been proposed, and reviews of existing methods are also provided. However, existing reviews are short of thorough investigations on a common benchmark. The present paper aims to review and benchmark existing methods in the new era of deep learning surface reconstruction. To this end, we contribute a large-scale benchmarking dataset consisting of both synthetic and real-scanned data; the benchmark includes object- and scene-level surfaces and takes into account various sensing imperfections that are commonly encountered in practical depth scanning. We conduct thorough empirical studies by comparing existing methods on the constructed benchmark, and pay special attention on robustness of existing methods against various scanning imperfections; we also study how different methods generalize in terms of reconstructing complex surface shapes. Our studies help identity the best conditions under which different methods work, and suggest some empirical findings. For example, while deep learning methods are increasingly popular in the research community, our systematic studies suggest that, surprisingly, a few classical methods perform even better in terms of both robustness and generalization; our studies also suggest that the practical challenges of misalignment of point sets from multi-view scanning, missing of surface points, and point outliers remain unsolved by all the existing surface reconstruction methods. We expect that the benchmark and our studies would be valuable both for practitioners and as a guidance for new innovations in future research. We make the benchmark publicly accessible at https://Gorilla-Lab-SCUT.github.io/SurfaceReconstructionBenchmark.

Unveiling limitations of 3D object reconstruction models through a novel benchmark

A Comparison of 3D Shape Retrieval Methods Based on a Large-Scale Benchmark Supporting Multimodal Queries

Comparative Evaluation of 3D Reconstruction Methods for Object Pose Estimation

Benchmarking Large-Scale Multi-View 3D Reconstruction Using Realistic Synthetic Images

THE ISPRS BENCHMARK ON INDOOR MODELLING

From 2D to 3D: Re-thinking Benchmarking of Monocular Depth Prediction

Large-Scale 3D Shape Reconstruction and Segmentation from ShapeNet Core55.

Results of the ISPRS Benchmark on Indoor Modelling

Benchmarking Encoder-Decoder Architectures for Biplanar X-ray to 3D Shape Reconstruction

PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understanding

Compact Model Representation for 3D Reconstruction

BelHouse3D: A Benchmark Dataset for Assessing Occlusion Robustness in 3D Point Cloud Semantic Segmentation

View-Based 3-D Model Retrieval: A Benchmark

Exploiting Object Similarity in 3D Reconstruction

Rethinking Sketch-Based 3D Shape Retrieval: A Simple Baseline and Benchmark Reconstruction

Surface Reconstruction from Point Clouds: A Survey and a Benchmark

Mismatched: Evaluating the Limits of Image Matching Approaches and Benchmarks

Reconstruction of 3D Object Shape Using Hybrid Modular Neural Network Architecture Trained on 3D Models from ShapeNetCore Dataset

GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmark

Component-Aware High-Resolution 3D Object Reconstruction

Benchmarks, Performance Evaluation and Contests for 3D Shape Retrieval