Abstract:Delineating and modelling building roof plane structures is an active research direction in urban-related studies, as understanding roof structure provides essential information for generating highly detailed 3D building models. Traditional deep-learning models have been the main focus of most recent research endeavors aiming to extract pixel-based building roof plane areas from remote-sensing imagery. However, significant challenges arise, such as delineating complex roof boundaries and invisible boundaries. Additionally, challenges during the post-processing phase, where pixel-based building roof plane maps are vectorized, often result in polygons with irregular shapes. In order to address this issue, this study explores a state-of-the-art method for planar graph reconstruction applied to building roof plane extraction. We propose a framework for reconstructing regularized building roof plane structures using aerial imagery and cadastral information. Our framework employs a holistic edge classification architecture based on an attention-based neural network to detect corners and edges between them from aerial imagery. Our experiments focused on three distinct study areas characterized by different roof structure topologies: the Stadsveld–'t Zwering neighborhood and Oude Markt area, located in Enschede, The Netherlands, and the Lozenets district in Sofia, Bulgaria. The outcomes of our experiments revealed that a model trained with a combined dataset of two different study areas demonstrated a superior performance, capable of delineating edges obscured by shadows or canopy. Our experiment in the Oude Markt area resulted in building roof plane delineation with an F-score value of 0.43 when the model trained on the combined dataset was used. In comparison, the model trained only on the Stadsveld–'t Zwering dataset achieved an F-score value of 0.37, and the model trained only on the Lozenets dataset achieved an F-score value of 0.32. The results from the developed approach are promising and can be used for 3D city modelling in different urban settings.

Learning to Generate 3D Representations of Building Roofs Using Single-View Aerial Imagery

Automatic Building Roof Plane Extraction in Urban Environments for 3D City Modelling Using Remote Sensing Data

Roof-GAN: Learning to Generate Roof Geometry and Relations for Residential Houses

Point2Building: Reconstructing Buildings from Airborne LiDAR Point Clouds

Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers

Intuitive and efficient roof modeling for reconstruction and synthesis

PolyGen: An Autoregressive Generative Model of 3D Meshes

sat2pc: Estimating Point Cloud of Building Roofs from 2D Satellite Images

Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds

Unsupervised Roofline Extraction from True Orthophotos for LoD2 Building Model Reconstruction

Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds

3D detection of roof sections from a single satellite image and application to LOD2-building reconstruction

Learning single-image 3D reconstruction by generative modelling of shape, pose and shading

Fine Detailed Texture Learning for 3D Meshes with Generative Models

GeoFormer: A Multi-Polygon Segmentation Transformer

Synthetic 3D Data Generation Pipeline for Geometric Deep Learning in Architecture

Recognition and reconstruction of buildings from multiple aerial images

Building 3D Generative Models from Minimal Data

Geometry aware 3D generation from in-the-wild images in ImageNet

3DILG: Irregular Latent Grids for 3D Generative Modeling

Unsupervised 3D Shape Learning from Image Collections in the Wild