Abstract:In the dynamic urban landscape, understanding the distribution of buildings is paramount. Extracting and delineating building footprints from high-resolution images, captured by aerial platforms or satellites, is essential but challenging to accomplish manually, due to the abundance of high-resolution data. Automation becomes imperative, yet it introduces complexities related to handling diverse data sources and the computational demands of advanced algorithms. The innovative solution proposed in this paper addresses some intricate challenges occurring when integrating deep learning and data fusion on Earth Observed imagery. By merging RGB orthophotos with Digital Surface Models, deriving from the same aerial high-resolution surveys, an integrated consistent four-band dataset is generated. This unified approach, focused on the extraction of height information through stereoscopy utilizing a singular source, facilitates enhanced pixel-to-pixel data fusion. Employing DeepLabv3 algorithms, a state-of-the-art semantic segmentation network for multi-scale context, pixel-based segmentation on the integrated dataset was performed, excelling in capturing intricate details, particularly when enhanced by the additional height information deriving from the Digital Surface Models acquired over urban landscapes. Evaluation over a 21 km 2 area in Turin, Italy, featuring diverse building frameworks, showcases how the proposed approach leads towards superior accuracy levels and building boundary refinement. Notably, the methodology discussed in the present article, significantly reduces training time compared to conventional approaches like U-Net, overcoming inherent challenges in high-resolution data automation. By establishing the effectiveness of leveraging DeepLabv3 algorithms on an integrated dataset for precise building footprint segmentation, the present contribution holds promise for applications in 3D modelling, Change detection and urban planning. An approach favouring the application of deep learning strategies on integrated high-resolution datasets can then guide decision-making processes facilitating urban management tasks.

Fully Automated Segmentation of 2D and 3D Mobile Mapping Data for Reliable Modeling of Surface Structures Using Deep Learning

From One To Many: Unsupervised Traversable Area Segmentation In Off-Road Environment

An Automatic Road Surface Segmentation in Non-Urban Environments: A 3D Point Cloud Approach With Grid Structure and Shallow Neural Networks

Revolutionizing urban mapping: deep learning and data fusion strategies for accurate building footprint segmentation

Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

Urban Three-dimensional (3-D) Road Surface Reconstruction Based on a Data Assimilation Algorithm Using a Mobile Laser Scanning (MLS) System

Classification and Change Detection in Mobile Mapping LiDAR Point Clouds

An unsupervised, open-source workflow for 2D and 3D building mapping from airborne LiDAR data

Efficient and Robust Semantic Mapping for Indoor Environments

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

Seamless Navigation, 3D Reconstruction, Thermographic and Semantic Mapping for Building Inspection

DeepAerialMapper: Deep Learning-based Semi-automatic HD Map Creation for Highly Automated Vehicles

Building a Fully-Automatized Active Learning Framework for the Semantic Segmentation of Geospatial 3D Point Clouds

A Comprehensive Framework for Transportation Infrastructure Digitalization: TJYRoad-Net for Enhanced Point Cloud Segmentation

BUILDING SECTION INSTANCE SEGMENTATION WITH COMBINED CLASSICAL AND DEEP LEARNING METHODS

THE IMPLEMENTATION OF SEMI-AUTOMATED ROAD SURFACE MARKINGS EXTRACTION SCHEMES UTILIZING MOBILE LASER SCANNED POINT CLOUDS FOR HD MAPS PRODUCTION

3D Road Boundary Extraction Based on Machine Learning Strategy Using LiDAR and Image-Derived MMS Point Clouds

Fully Automated Photogrammetric Data Segmentation and Object Information Extraction Approach for Creating Simulation Terrain

3D lidar point-cloud projection operator and transfer machine learning for effective road surface features detection and segmentation

AUTOMATIC BUILDING FOOTPRINT EXTRACTION FROM 3D LASERSCANS

A Comprehensive Automated 3D Approach for Building Extraction, Reconstruction, and Regularization from Airborne Laser Scanning Point Clouds