ARCH2S: Dataset, Benchmark and Challenges for Learning Exterior Architectural Structures from Point Clouds

Ka Lung Cheung,Chi Chung Lee
2024-06-03
Abstract:Precise segmentation of architectural structures provides detailed information about various building components, enhancing our understanding and interaction with our built environment. Nevertheless, existing outdoor 3D point cloud datasets have limited and detailed annotations on architectural exteriors due to privacy concerns and the expensive costs of data acquisition and annotation. To overcome this shortfall, this paper introduces a semantically-enriched, photo-realistic 3D architectural models dataset and benchmark for semantic segmentation. It features 4 different building purposes of real-world buildings as well as an open architectural landscape in Hong Kong. Each point cloud is annotated into one of 14 semantic classes.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem this paper attempts to address is the lack of detailed annotations regarding the external structures of buildings in existing outdoor 3D point cloud datasets. Specifically, due to privacy concerns and the high costs of data collection and annotation, existing datasets have limited and insufficient annotations for external building structures. This results in challenges in capturing a comprehensive view of building exteriors, especially in road-level datasets where large buildings are often abstracted as single entities, and detailed structures are overlooked due to sensor limitations. Although some facade-specific datasets have emerged recently, they mainly focus on building components on vertical and planar walls, neglecting external structures at the ground and roof levels. To overcome these shortcomings, this paper introduces a semantically rich, photorealistic 3D building model dataset and benchmark (ARCH2S) aimed at semantic segmentation. The dataset includes real-world buildings of 4 different uses and an open building landscape in Hong Kong. Each point cloud is annotated as one of 14 semantic categories, covering various common elements of building exteriors, thus providing detailed classification and differentiation of different structural features. The establishment of this dataset contributes to advancements in urban planning, construction efficiency improvement, heritage preservation, autonomous driving technology, and other fields.