Abstract:Accurate building extraction from remotely sensed data is difficult to perform automatically because of the complex environments and the complex shapes, colours and textures of buildings. Supervised deep-learning-based methods offer a possible solution to solve this problem. However, these methods generally require many high-quality, manually labelled samples to obtain satisfactory test results, and their production is time and labour intensive. For multimodal data with sufficient information, extracting buildings accurately in as unsupervised a manner as possible. Combining remote sensing images and LiDAR point clouds for unsupervised building extraction is not a new idea, but existing methods often experience two problems: (1) the accuracy of vegetation detection is often not high, which leads to limited building extraction accuracy, and (2) they lack a proper mechanism to further refine the building masks. We propose two methods to address these problems, combining aerial images and aerial LiDAR point clouds. First, we improve two recently developed vegetation detection methods to generate accurate initial building masks. We then refine the building masks based on the image feature consistency constraint, which can replace inaccurate LiDAR-derived boundaries with accurate image-based boundaries, remove the remaining vegetation points and recover some missing building points. Our methods do not require manual parameter tuning or manual data labelling, but still exhibit a competitive performance compared to 29 methods: our methods exhibit accuracies higher than or comparable to 19 state-of-the-art methods (including 8 deep-learning-based methods and 11 unsupervised methods, and 9 of them combine remote sensing images and 3D data), and outperform the top 10 methods (4 of them combine remote sensing images and LiDAR data) evaluated using all three test areas of the Vaihingen dataset on the official website of the ISPRS Test Project on Urban Classification and 3D Building Reconstruction in average area quality. These comparative results verify that our unsupervised methods combining multisource data are very effective.

Building segmentation and outline extraction from UAV image-derived point clouds by a line growing algorithm

Advanced-Technological UAVs-Based Enhanced Reconstruction of Edges for Building Models

Contour Extraction of UAV Point Cloud Based on Neighborhood Geometric Features of Multi-Level Growth Plane

AUTOMATIC EXTRACTION OF BUILDING OUTLINE FROM HIGH RESOLUTION AERIAL IMAGERY

UAV building point cloud contour extraction based on the feature recognition of adjacent points distribution

Building footprint extraction from aerial photogrammetric point cloud data using its geometric features

A Robust Segmentation Framework for Closely Packed Buildings from Airborne LiDAR Point Clouds

The Extraction of Roof Feature Lines of Traditional Chinese Village Buildings Based on UAV Dense Matching Point Clouds

3D Urban Buildings Extraction Based on Airborne LiDAR and Photogrammetric Point Cloud Fusion According to U-Net Deep Learning Model Segmentation

Research on extraction algorithm of building outline based on point cloud

Automatic Building Extraction from Very High Resolution Satellite Imagery Using Line Segment Detector.

An Algorithm for Building Exterior Facade Corner Point Extraction Based on UAV Images and Point Clouds

Robust Extraction of 3D Line Segment Features from Unorganized Building Point Clouds

Deep learning-based multi-feature semantic segmentation in building extraction from images of UAV photogrammetry

An Automatic Building Extraction and Regularisation Technique Using LiDAR Point Cloud Data and Orthoimage

Building extraction from oblique photogrammetry point clouds based on PointNet++ with attention mechanism

Unsupervised Building Extraction from Multimodal Aerial Data Based on Accurate Vegetation Removal and Image Feature Consistency Constraint

The Extraction of Buildings Elevation Information on UAV DSM.

Robust segmentation of building points from airborne LiDAR data and imagery

Survey of Built Environment in the Era of UAV: from Aerial Photogrammetry to Point Cloud Classification