Abstract:Automatic building detection from remote sensing images holds significant applications in various domains, including cartography, land-use change detection, urban planning, and 3D intelligent city construction. Driven by the innovation of deep learning technology, convolutional neural networks (CNNs) have emerged as a powerful framework for automatic interpretation, exhibiting hierarchical feature generation and robust representation for building extraction. However, the inherent computational limitations of convolutional operators hinder the acquisition of an effective global receptive field. Recent advancements in deep learning have witnessed the adoption of the multi-head self-attention (MHSA) mechanism by Transformer, presenting the superiority of global context construction. Nonetheless, this network structure encounters difficulties in effectively modelling two-dimensional spatial structure features with scale variation in semantic segmentation and often has huge parameters with high algorithm complexity. To address the above problems, this paper proposed a hybrid deep neural network synergistically harnessing the superiority of CNN and Transformer to extract buildings from remote sensing images. Meanwhile, an improved MHSA mechanism is developed to facilitate the construction of multiscale global representations, concurrently reducing computational complexity. Furthermore, the cross-level MHSA modules the semantic correlation between the deep and shallow-level features to refine spatial fine-grained information. The proposed method was comprehensively evaluated on two building datasets via quantitative analysis and visualization. The experimental results confirmed that the developed network and modules outperform other state-of-the-art methods and can effectively improve the accuracy (93.4% F1-score on the WHU dataset, 89.38% F1-score on the CAMB dataset) with high efficiency for building extraction.

A scale robust convolutional neural network for automatic building extraction from aerial and satellite imagery

Automatic Building Extraction on High-Resolution Remote Sensing Imagery Using Deep Convolutional Encoder-Decoder with Spatial Pyramid Pooling.

Multiregion Scale-Aware Network for Building Extraction From High-Resolution Remote Sensing Images

Automatic Building Extraction in Aerial Scenes Using Convolutional Networks

Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery

Building Extraction from High-Resolution Remote-Sensing Images Based on Deep Learning

Urban building extraction from high-resolution remote sensing imagery based on multi-scale recurrent conditional generative adversarial network

E-D-Net: Automatic Building Extraction from High-Resolution Aerial Images with Boundary Information

A Deep Residual Learning Serial Segmentation Network for Extracting Buildings from Remote Sensing Imagery

Automatic Building Extraction from High-Resolution Aerial Imagery Via Fully Convolutional Encoder-Decoder Network with Non-Local Block

Scale-Robust Deep-Supervision Network for Mapping Building Footprints From High-Resolution Remote Sensing Images

Extracting Buildings from Remote Sensing Images Using a Multitask Encoder-Decoder Network with Boundary Refinement

Fusion of Multiscale Convolutional Neural Networks for Building Extraction in Very High-Resolution Images.

Asymmetric Network Combining CNN and Transformer for Building Extraction from Remote Sensing Images

Multi-Scale Feature Fusion Attention Network for Building Extraction in Remote Sensing Images

Multiscale U-Shaped CNN Building Instance Extraction Framework with Edge Constraint for High-Spatial-Resolution Remote Sensing Imagery

Multi-scale Edge Constrained for Building Semantic Segmentation Using High Resolution Remote Sensing Images

Attention-Gate-Based Encoder–Decoder Network for Automatical Building Extraction

Building Extraction From High Spatial Resolution Remote Sensing Images of Complex Scenes by Combining Region-Line Feature Fusion and OCNN

SCA-Net: A Multiscale Building Segmentation Network Incorporating a Dual-Attention Mechanism

BUILDING OUTLINE EXTRACTION FROM AERIAL IMAGES USING CONVOLUTIONAL NEURAL NETWORKS