Abstract:Automatic building detection from remote sensing images holds significant applications in various domains, including cartography, land-use change detection, urban planning, and 3D intelligent city construction. Driven by the innovation of deep learning technology, convolutional neural networks (CNNs) have emerged as a powerful framework for automatic interpretation, exhibiting hierarchical feature generation and robust representation for building extraction. However, the inherent computational limitations of convolutional operators hinder the acquisition of an effective global receptive field. Recent advancements in deep learning have witnessed the adoption of the multi-head self-attention (MHSA) mechanism by Transformer, presenting the superiority of global context construction. Nonetheless, this network structure encounters difficulties in effectively modelling two-dimensional spatial structure features with scale variation in semantic segmentation and often has huge parameters with high algorithm complexity. To address the above problems, this paper proposed a hybrid deep neural network synergistically harnessing the superiority of CNN and Transformer to extract buildings from remote sensing images. Meanwhile, an improved MHSA mechanism is developed to facilitate the construction of multiscale global representations, concurrently reducing computational complexity. Furthermore, the cross-level MHSA modules the semantic correlation between the deep and shallow-level features to refine spatial fine-grained information. The proposed method was comprehensively evaluated on two building datasets via quantitative analysis and visualization. The experimental results confirmed that the developed network and modules outperform other state-of-the-art methods and can effectively improve the accuracy (93.4% F1-score on the WHU dataset, 89.38% F1-score on the CAMB dataset) with high efficiency for building extraction.

A Cascaded Network With Coupled High-Low Frequency Features for Building Extraction

A cross-stage features fusion network for building extraction from remote sensing images

B-FGC-Net: A Building Extraction Network from High Resolution Remote Sensing Imagery

CSA-Net: Complex Scenarios Adaptive Network for Building Extraction for Remote Sensing Images

Hierarchical Disentangling Network for Building Extraction from Very High Resolution Optical Remote Sensing Imagery

Asymmetric Network Combining CNN and Transformer for Building Extraction from Remote Sensing Images

Extracting Buildings from Remote Sensing Images Using a Multitask Encoder-Decoder Network with Boundary Refinement

Multi-Scale Feature Fusion Attention Network for Building Extraction in Remote Sensing Images

Combining Deep Fully Convolutional Network and Graph Convolutional Neural Network for the Extraction of Buildings from Aerial Images

SCA-Net: A Multiscale Building Segmentation Network Incorporating a Dual-Attention Mechanism

Attention-Gate-Based Encoder–Decoder Network for Automatical Building Extraction

Building Extraction from Very High Resolution Aerial Imagery Using Joint Attention Deep Neural Network

ACMFNet: Attention-Based Cross-Modal Fusion Network for Building Extraction of Remote Sensing Images

Building Multi-Feature Fusion Refined Network for Building Extraction from High-Resolution Remote Sensing Images

EA U2-Net: An Efficient Building Extraction Algorithm Based on Complex Background Information

Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery

Building Extraction From High Spatial Resolution Remote Sensing Images of Complex Scenes by Combining Region-Line Feature Fusion and OCNN

EU-Net: an Efficient Fully Convolutional Network for Building Extraction from Optical Remote Sensing Images.

SDSNet: Building Extraction in High-Resolution Remote Sensing Images Using a Deep Convolutional Network with Cross-Layer Feature Information Interaction Filtering

A Dual-Branch Fusion Network Based on Reconstructed Transformer for Building Extraction in Remote Sensing Imagery

Asymmetric Cascade Fusion Network for Building Extraction