Abstract:Large-scale 2D datasets have been instrumental in advancing machine learning; however, progress in 3D vision tasks has been relatively slow. This disparity is largely due to the limited availability of 3D benchmarking datasets. In particular, creating real-world point cloud datasets for indoor scene semantic segmentation presents considerable challenges, including data collection within confined spaces and the costly, often inaccurate process of per-point labeling to generate ground truths. While synthetic datasets address some of these challenges, they often fail to replicate real-world conditions, particularly the occlusions that occur in point clouds collected from real environments. Existing 3D benchmarking datasets typically evaluate deep learning models under the assumption that training and test data are independently and identically distributed (IID), which affects the models' usability for real-world point cloud segmentation. To address these challenges, we introduce the BelHouse3D dataset, a new synthetic point cloud dataset designed for 3D indoor scene semantic segmentation. This dataset is constructed using real-world references from 32 houses in Belgium, ensuring that the synthetic data closely aligns with real-world conditions. Additionally, we include a test set with data occlusion to simulate out-of-distribution (OOD) scenarios, reflecting the occlusions commonly encountered in real-world point clouds. We evaluate popular point-based semantic segmentation methods using our OOD setting and present a benchmark. We believe that BelHouse3D and its OOD setting will advance research in 3D point cloud semantic segmentation for indoor scenes, providing valuable insights for the development of more generalizable models.

InLUT3D: Challenging real indoor dataset for point cloud analysis

LiDAR-Net: A Real-scanned 3D Point Cloud Dataset for Indoor Scenes

BelHouse3D: A Benchmark Dataset for Assessing Occlusion Robustness in 3D Point Cloud Semantic Segmentation

Building-PCC: Building Point Cloud Completion Benchmarks

Building3D: An Urban-Scale Dataset and Benchmarks for Learning Roof Structures from Point Clouds

LASDU: A Large-Scale Aerial LiDAR Dataset for Semantic Labeling in Dense Urban Areas.

Paris-CARLA-3D: A Real and Synthetic Outdoor Point Cloud Dataset for Challenging Tasks in 3D Mapping

A 3D INDOOR-OUTDOOR BENCHMARK DATASET FOR LoD3 BUILDING POINT CLOUD SEMANTIC SEGMENTATION

WHU-Urban3D: An urban scene LiDAR point cloud dataset for semantic instance segmentation

Automated Methods for Indoor Point Cloud Preprocessing: Coordinate Frame Reorientation and Building Exterior Removal

Campus3D: A Photogrammetry Point Cloud Benchmark for Hierarchical Understanding of Outdoor Scene

Labelled Indoor Point Cloud Dataset for BIM Related Applications

THE ISPRS BENCHMARK ON INDOOR MODELLING

Global Registration of 3D LiDAR Point Clouds Based on Scene Features: Application to Structured Environments

Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset, Benchmarks and Challenges

Matterport3D: Learning from RGB-D Data in Indoor Environments

InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset

Comparison of the Selected State-Of-The-Art 3D Indoor Scanning and Point Cloud Generation Methods

Developing a Comprehensive 3D Point Cloud Dataset for Construction Projects

UniDet3D: Multi-dataset Indoor 3D Object Detection

DublinCity: Annotated LiDAR Point Cloud and its Applications