Abstract:The LiDAR and photogrammetric point clouds fusion procedure for building extraction according to U-Net deep learning model segmentation is provided and tested. Firstly, an initial geo-localization process is performed for photogrammetric point clouds generated using structure-from-motion and dense-matching methods. Then, point cloud segmentation is carried out based on U-Net deep learning model. The precision of the U-Net model for buildings extraction reachs 87%, with F-score of 0.89 and IoU of 0.80. It is shown that the U-Net method is effective for high-resolution image extraction. The detailed information can accurately be identified and extracted, such as vegetation located between buildings and roads. After segmentation, each chunk of the LiDAR and photogrammetric point clouds are finely registered and merged based on the iterative closest point algorithm. Finally, the fused point clouds are obtained. It shows that the structure and shape of the buildings could be delineated from the fused point clouds when both enough ground points and a higher point density are available. Furthermore, color information improves both visualization effect and properties identification. The experiments are conducted to extract individual buildings from three types of point clouds in three plots. A DoN (Difference of Normals) approach is used to isolate 3D buildings from other objects in densely built-up areas. It shows that most building extraction results have a Precision > 0.9 and favorable Recall and F-score values. Although the LiDAR extraction results have some advantages over the photogrammetric and fused ones in terms of Precision, the Recall and F-score results appear best for the fused point clouds. It shows that the fused data contains a high point density and RGB color information and could improve the building extraction.

Survey of Built Environment in the Era of UAV: from Aerial Photogrammetry to Point Cloud Classification

Building Information Extraction and Earthquake Damage Prediction in an Old Urban Area Based on UAV Oblique Photogrammetry

Advanced-Technological UAVs-Based Enhanced Reconstruction of Edges for Building Models

Unmanned aerial vehicle-based as-built surveys of buildings

Investigation, Evaluation, and Dynamic Monitoring of Traditional Chinese Village Buildings Based on Unmanned Aerial Vehicle Images and Deep Learning Methods

Application of Computer UAV Remote Sensing Technology in Building Engineering Surveying and Mapping

Building segmentation and outline extraction from UAV image-derived point clouds by a line growing algorithm

Three-dimensional modeling and application based on UAV tilt photogrammetry technology

Using High-Resolution Imagery Acquired with an Autonomous Unmanned Aerial Vehicle for Urban Construction and Planning

Deep Learning Approach to Point Cloud Scene Understanding for Automated Scan to 3D Reconstruction

Feature extraction and analysis of landscape imaging using drones and machine vision

Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds

Building 3D Realistic Modeling Based on Air-ground Multi-source Data Fusion

Method of Defining the Parameters for UAV Point Cloud Classification Algorithm

3D LoD2 modelling of Halong City based on UAV point cloud

Automatic identification of building structure types using unmanned aerial vehicle oblique images and deep learning considering facade prior knowledge

3D Urban Buildings Extraction Based on Airborne LiDAR and Photogrammetric Point Cloud Fusion According to U-Net Deep Learning Model Segmentation

A Robust Segmentation Framework for Closely Packed Buildings from Airborne LiDAR Point Clouds

A Method of Making DEM by Data Fusion of Multi-Device Point Cloud

Building Change Detection with RGB-D Map Generated from UAV Images

Combined use of Terrestrial Laser Scanning and UAV Photogrammetry in producing the LoD3 of 3D high building model