Abstract:Automatic building detection from remote sensing images holds significant applications in various domains, including cartography, land-use change detection, urban planning, and 3D intelligent city construction. Driven by the innovation of deep learning technology, convolutional neural networks (CNNs) have emerged as a powerful framework for automatic interpretation, exhibiting hierarchical feature generation and robust representation for building extraction. However, the inherent computational limitations of convolutional operators hinder the acquisition of an effective global receptive field. Recent advancements in deep learning have witnessed the adoption of the multi-head self-attention (MHSA) mechanism by Transformer, presenting the superiority of global context construction. Nonetheless, this network structure encounters difficulties in effectively modelling two-dimensional spatial structure features with scale variation in semantic segmentation and often has huge parameters with high algorithm complexity. To address the above problems, this paper proposed a hybrid deep neural network synergistically harnessing the superiority of CNN and Transformer to extract buildings from remote sensing images. Meanwhile, an improved MHSA mechanism is developed to facilitate the construction of multiscale global representations, concurrently reducing computational complexity. Furthermore, the cross-level MHSA modules the semantic correlation between the deep and shallow-level features to refine spatial fine-grained information. The proposed method was comprehensively evaluated on two building datasets via quantitative analysis and visualization. The experimental results confirmed that the developed network and modules outperform other state-of-the-art methods and can effectively improve the accuracy (93.4% F1-score on the WHU dataset, 89.38% F1-score on the CAMB dataset) with high efficiency for building extraction.

Asymmetric Cascade Fusion Network for Building Extraction

Asymmetric Network Combining CNN and Transformer for Building Extraction from Remote Sensing Images

A Cascaded Network With Coupled High-Low Frequency Features for Building Extraction

A Dual-Branch Fusion Network Based on Reconstructed Transformer for Building Extraction in Remote Sensing Imagery

Building Extraction from Very High Resolution Aerial Imagery Using Joint Attention Deep Neural Network

ACMFNet: Attention-Based Cross-Modal Fusion Network for Building Extraction of Remote Sensing Images

Multiscale U-Shaped CNN Building Instance Extraction Framework with Edge Constraint for High-Spatial-Resolution Remote Sensing Imagery

Fusion of Multiscale Convolutional Neural Networks for Building Extraction in Very High-Resolution Images.

Multi-Scale Frequency-Spatial Domain Attention Fusion Network for Building Extraction in Remote Sensing Images

CSA-Net: Complex Scenarios Adaptive Network for Building Extraction for Remote Sensing Images

Effective Building Extraction From High-Resolution Remote Sensing Images With Multitask Driven Deep Neural Network

Complementarity-aware Local-global Feature Fusion Network for Building Extraction in Remote Sensing Images

Building Multi-Feature Fusion Refined Network for Building Extraction from High-Resolution Remote Sensing Images

A cross-stage features fusion network for building extraction from remote sensing images

MSRF-Net: Multiscale Receptive Field Network for Building Detection From Remote Sensing Images

Hierarchical Disentangling Network for Building Extraction from Very High Resolution Optical Remote Sensing Imagery

Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery

A Multi-Branch Feature Fusion Network for Building Detection in Remote Sensing Images

B-FGC-Net: A Building Extraction Network from High Resolution Remote Sensing Imagery

Multiregion Scale-Aware Network for Building Extraction From High-Resolution Remote Sensing Images

Feature Aggregation Network for Building Extraction from High-resolution Remote Sensing Images