Abstract:In many urban planning and visualization applications, it is crucial to have 3D window details. However, the process of acquiring and reconstructing them can be challenging. Therefore, in many 3D city models, buildings often lack 3D windows. Instead, their building façades are usually represented using 2D planar textures (i.e., LoD2 CityGML models with textures). To generate a 3D façade from 2D images, current methods often need to carefully design various grammars to achieve desired results, which can be tedious. A useful property of building, the window semantics information, is also lacking. The main contribution of this paper is proposing a semantics-aware method for addition and LoD control of 3D window details to LoD2 CityGML models with textures (namely SLOD2+WIN ). A deep learning-based two-level window-pane detection is introduced, and the detection results are then processed and adjusted to generate 3D windows and add to the building models. Unlike other methods, the semantics (i.e., frames and panes) are considered for adding window details. We also propose and integrate a LoD scheme for 3D windows following the same concept as the LoD in CityGML. The tedious efforts of reconstruction or grammar creation can be reduced in our method. Only the information present in the texture itself is extracted, and the shape and pattern information of windows are obtained and adjusted from the detection results in an efficient and unsupervised manner to achieve neat window parsing. Specifically, clustering-based window/pane alignment, neatness-based window image voting, grid-based symmetry, thickness filtering, and fitting-based window-top modeling are proposed. To demonstrate the effectiveness and usefulness of SLOD2+WIN , experiments on several datasets of 3D cities are conducted to add 3D window details with the novel LoD schema, illustrative applications in architectural visualization and urban planning are also showcased. This paper extended its conference version.

WinSet: The First Multi-Modal Window Dataset for Heterogeneous Window States

Window Detection in Facades Using Heatmap Fusion

DiLiGenT102: A Photometric Stereo Benchmark Dataset with Controlled Shape and Material Variation

Towards a data-driven and scalable approach for window operation detection in multi-family residential buildings

A new algorithm for real-time detection of window opening area in residential buildings

Automated Assessment of Wind Damage to Windows of Buildings at a City Scale Based on Oblique Photography, Deep Learning and CFD

SLOD2+WIN: semantics-aware addition and LoD of 3D window details for LoD2 CityGML models with textures

CIM-WV: A 2D semantic segmentation dataset of rich window view contents in high-rise, high-density Hong Kong based on photorealistic city information models

A New Dataset for Intelligent Multi-Modal Sensing-Communication Integration in Low-Altitude Scenarios

A holistic investigation into the seasonal and temporal variations of window opening behavior in residential buildings in Chongqing, China

Window to Wall Ratio Detection using SegFormer

Study on influencing factors for occupant window-opening behavior: Case study of an office building in Xi'an during the transition season

Dataset of Windows operating system forensics artefacts

CityUPlaces: a new dataset for efficient vision-based recognition

OpenMPD: An Open Multimodal Perception Dataset for Autonomous Driving

Image dataset: Year-long hourly façade photos of a university building

Windows and Doors Extraction from Point Cloud Data Combining Semantic Features and Material Characteristics

A room with a view: Automatic assessment of window views for high-rise high-density areas using City Information Models and deep transfer learning

Open-Set 3D Detection via Image-level Class and Debiased Cross-modal Contrastive Learning

Multi-Modal Lidar Dataset for Benchmarking General-Purpose Localization and Mapping Algorithms

Window Opening Behavior of Residential Buildings during the Transitional Season in China's Xi'an