Abstract:Delineating and modelling building roof plane structures is an active research direction in urban-related studies, as understanding roof structure provides essential information for generating highly detailed 3D building models. Traditional deep-learning models have been the main focus of most recent research endeavors aiming to extract pixel-based building roof plane areas from remote-sensing imagery. However, significant challenges arise, such as delineating complex roof boundaries and invisible boundaries. Additionally, challenges during the post-processing phase, where pixel-based building roof plane maps are vectorized, often result in polygons with irregular shapes. In order to address this issue, this study explores a state-of-the-art method for planar graph reconstruction applied to building roof plane extraction. We propose a framework for reconstructing regularized building roof plane structures using aerial imagery and cadastral information. Our framework employs a holistic edge classification architecture based on an attention-based neural network to detect corners and edges between them from aerial imagery. Our experiments focused on three distinct study areas characterized by different roof structure topologies: the Stadsveld–'t Zwering neighborhood and Oude Markt area, located in Enschede, The Netherlands, and the Lozenets district in Sofia, Bulgaria. The outcomes of our experiments revealed that a model trained with a combined dataset of two different study areas demonstrated a superior performance, capable of delineating edges obscured by shadows or canopy. Our experiment in the Oude Markt area resulted in building roof plane delineation with an F-score value of 0.43 when the model trained on the combined dataset was used. In comparison, the model trained only on the Stadsveld–'t Zwering dataset achieved an F-score value of 0.37, and the model trained only on the Lozenets dataset achieved an F-score value of 0.32. The results from the developed approach are promising and can be used for 3D city modelling in different urban settings.

A Novel Deep Learning Based Classification of Building Roof Types Using Point Cloud Data

Classifying point clouds at the facade-level using geometric features and deep learning networks

AERIAL POINT CLOUD CLASSIFICATION WITH DEEP LEARNING AND MACHINE LEARNING ALGORITHMS

AN EXTRACTION METHOD FOR ROOF POINT CLOUD OF ANCIENT BUILDING USING DEEP LEARNING FRAMEWORK

A novel parallel classification network for classifying three-dimensional surface with point cloud data

Point Cloud-Based 3D Object Classification With Non Local Attention and Lightweight Convolution Neural Networks

Deep Learning Approach to Point Cloud Scene Understanding for Automated Scan to 3D Reconstruction

Deep Roof Refiner: A detail-oriented deep learning network for refined delineation of roof structure lines using satellite imagery

Point Cloud Classification by Dynamic Graph CNN with Adaptive Feature Fusion.

Cloud type classification using deep learning with cloud images

Automatic Building Roof Plane Extraction in Urban Environments for 3D City Modelling Using Remote Sensing Data

Classification of raw LiDAR point cloud using point-based methods with spatial features for 3D building reconstruction

Deep Learning for LiDAR Point Cloud Classification in Remote Sensing

Roof Shape Classification from LiDAR and Satellite Image Data Fusion Using Supervised Learning

sat2pc: Estimating Point Cloud of Building Roofs from 2D Satellite Images

A Comparison of Deep Learning Methods for Airborne Lidar Point Clouds Classification

Plane segmentation for a building roof combining deep learning and the RANSAC method from a 3D point cloud

Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds

Deep Learning Architect: Classification for Architectural Design Using Artificial Intelligence

A FEATURE-BASED DEEP LEARNING APPROACH FOR THE EXTRACTION OF GROUND POINTS FROM 3D POINT CLOUDS