Abstract:Accurate building extraction from remotely sensed data is difficult to perform automatically because of the complex environments and the complex shapes, colours and textures of buildings. Supervised deep-learning-based methods offer a possible solution to solve this problem. However, these methods generally require many high-quality, manually labelled samples to obtain satisfactory test results, and their production is time and labour intensive. For multimodal data with sufficient information, extracting buildings accurately in as unsupervised a manner as possible. Combining remote sensing images and LiDAR point clouds for unsupervised building extraction is not a new idea, but existing methods often experience two problems: (1) the accuracy of vegetation detection is often not high, which leads to limited building extraction accuracy, and (2) they lack a proper mechanism to further refine the building masks. We propose two methods to address these problems, combining aerial images and aerial LiDAR point clouds. First, we improve two recently developed vegetation detection methods to generate accurate initial building masks. We then refine the building masks based on the image feature consistency constraint, which can replace inaccurate LiDAR-derived boundaries with accurate image-based boundaries, remove the remaining vegetation points and recover some missing building points. Our methods do not require manual parameter tuning or manual data labelling, but still exhibit a competitive performance compared to 29 methods: our methods exhibit accuracies higher than or comparable to 19 state-of-the-art methods (including 8 deep-learning-based methods and 11 unsupervised methods, and 9 of them combine remote sensing images and 3D data), and outperform the top 10 methods (4 of them combine remote sensing images and LiDAR data) evaluated using all three test areas of the Vaihingen dataset on the official website of the ISPRS Test Project on Urban Classification and 3D Building Reconstruction in average area quality. These comparative results verify that our unsupervised methods combining multisource data are very effective.

A self-supervised building extraction method based on multi-modal remote sensing data

Unsupervised Building Extraction from Multimodal Aerial Data Based on Accurate Vegetation Removal and Image Feature Consistency Constraint

Building extraction based on hyperspectral remote sensing images and semisupervised deep learning with limited training samples

Extracting Buildings from Remote Sensing Images Using a Multitask Encoder-Decoder Network with Boundary Refinement

Building Extraction From High Spatial Resolution Remote Sensing Images of Complex Scenes by Combining Region-Line Feature Fusion and OCNN

Building Extraction from High-Resolution Remote-Sensing Images Based on Deep Learning

Building Extraction from Very-High-Resolution Remote Sensing Images Using Semi-Supervised Semantic Edge Detection

EA U2-Net: An Efficient Building Extraction Algorithm Based on Complex Background Information

A Method for Extracting Building Information from Remote Sensing Images Based on Deep Learning

Multi-scale Edge Constrained for Building Semantic Segmentation Using High Resolution Remote Sensing Images

Multi-Scale Feature Fusion Attention Network for Building Extraction in Remote Sensing Images

Urban building extraction from high-resolution remote sensing imagery based on multi-scale recurrent conditional generative adversarial network

Semantic Segmentation Network Combined with Edge Detection for Building Extraction in Remote Sensing Images

Multi-Level Perceptual Network for Urban Building Extraction from High-Resolution Remote Sensing Images

Building Extraction from Remotely Sensed Images by Integrating Saliency Cue

Effective Building Extraction From High-Resolution Remote Sensing Images With Multitask Driven Deep Neural Network

SNLRUX++ for Building Extraction From High-Resolution Remote Sensing Images

A Multi-Scale Edge Constraint Network for the Fine Extraction of Buildings from Remote Sensing Images

A Building Extraction Method for High-Resolution Remote Sensing Images with Multiple Attentions and Parallel Encoders Combining Enhanced Spectral Information

ACMFNet: Attention-Based Cross-Modal Fusion Network for Building Extraction of Remote Sensing Images

Efficient Building Extraction for High Spatial Resolution Images Based on Dual Attention Network