Abstract:Accurate building extraction from remotely sensed data is difficult to perform automatically because of the complex environments and the complex shapes, colours and textures of buildings. Supervised deep-learning-based methods offer a possible solution to solve this problem. However, these methods generally require many high-quality, manually labelled samples to obtain satisfactory test results, and their production is time and labour intensive. For multimodal data with sufficient information, extracting buildings accurately in as unsupervised a manner as possible. Combining remote sensing images and LiDAR point clouds for unsupervised building extraction is not a new idea, but existing methods often experience two problems: (1) the accuracy of vegetation detection is often not high, which leads to limited building extraction accuracy, and (2) they lack a proper mechanism to further refine the building masks. We propose two methods to address these problems, combining aerial images and aerial LiDAR point clouds. First, we improve two recently developed vegetation detection methods to generate accurate initial building masks. We then refine the building masks based on the image feature consistency constraint, which can replace inaccurate LiDAR-derived boundaries with accurate image-based boundaries, remove the remaining vegetation points and recover some missing building points. Our methods do not require manual parameter tuning or manual data labelling, but still exhibit a competitive performance compared to 29 methods: our methods exhibit accuracies higher than or comparable to 19 state-of-the-art methods (including 8 deep-learning-based methods and 11 unsupervised methods, and 9 of them combine remote sensing images and 3D data), and outperform the top 10 methods (4 of them combine remote sensing images and LiDAR data) evaluated using all three test areas of the Vaihingen dataset on the official website of the ISPRS Test Project on Urban Classification and 3D Building Reconstruction in average area quality. These comparative results verify that our unsupervised methods combining multisource data are very effective.

Self-Supervised Pretraining Framework for Extracting Global Structures From Building Point Clouds via Completion

Self-Supervised Global-Local Structure Modeling for Point Cloud Domain Adaptation with Reliable Voted Pseudo Labels

Self-Supervised Pre-Training for 3-D Roof Reconstruction on LiDAR Data

A Robust Automatic Method to Extract Building Facade Maps from 3D Point Cloud Data

Building Extraction From High Spatial Resolution Remote Sensing Images of Complex Scenes by Combining Region-Line Feature Fusion and OCNN

Deep Learning Approach to Point Cloud Scene Understanding for Automated Scan to 3D Reconstruction

Self-supervised Point Cloud Completion on Real Traffic Scenes via Scene-concerned Bottom-up Mechanism

A Complete Building Extraction Framework for Airborne Laser Scanning Point Cloud

A Multiscale and Multitask Deep Learning Framework for Automatic Building Extraction

3D Urban Buildings Extraction Based on Airborne LiDAR and Photogrammetric Point Cloud Fusion According to U-Net Deep Learning Model Segmentation

Unsupervised Building Extraction from Multimodal Aerial Data Based on Accurate Vegetation Removal and Image Feature Consistency Constraint

A Framework for Building Point Cloud Cleaning, Plane Detection and Semantic Segmentation

Building-PCC: Building Point Cloud Completion Benchmarks

Building façade element extraction based on multidimensional virtual semantic feature map ensemble learning and hierarchical clustering

3DPCTN: Two 3D Local-Object Point-Cloud-Completion Transformer Networks Based on Self-Attention and Multi-Resolution

PointGLR: Unsupervised Structural Representation Learning of 3D Point Clouds

A Building Point Cloud Extraction Algorithm in Complex Scenes

Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting

Self-supervised Point Cloud Representation Learning Via Separating Mixed Shapes

Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds

PointCG: Self-supervised Point Cloud Learning via Joint Completion and Generation