Abstract:Building contour extraction from high-resolution remote sensing images is a basic task for the reasonable planning of regional construction. Recently, building segmentation methods based on the U-Net network have become popular as they largely improve the segmentation accuracy by applying ‘skip connection’ to combine high-level and low-level feature information more effectively. Meanwhile, researchers have demonstrated that introducing an attention mechanism into U-Net can enhance local feature expression and improve the performance of building extraction in remote sensing images. In this paper, we intend to explore the effectiveness of the primeval attention gate module and propose the novel Attention Gate Module (AG) based on adjusting the position of ‘Resampler’ in an attention gate to Sigmoid function for a building extraction task, and a novel Attention Gates U network (AGs-Unet) is further proposed based on AG, which can automatically learn different forms of building structures in high-resolution remote sensing images and realize efficient extraction of building contour. AGs-Unet integrates attention gates with a single U-Net network, in which a series of attention gate modules are added into the ‘skip connection’ for suppressing the irrelevant and noisy feature responses in the input image to highlight the dominant features of the buildings in the image. AGs-Unet improves the feature selection of the attention map to enhance the ability of feature learning, as well as paying attention to the feature information of small-scale buildings. We conducted the experiments on the WHU building dataset and the INRIA Aerial Image Labeling dataset, in which the proposed AGs-Unet model is compared with several classic models (such as FCN8s, SegNet, U-Net, and DANet) and two state-of-the-art models (such as PISANet, and ARC-Net). The extraction accuracy of each model is evaluated by using three evaluation indexes, namely, overall accuracy, precision, and intersection over union. Experimental results show that the proposed AGs-Unet model can improve the quality of building extraction from high-resolution remote sensing images effectively in terms of prediction performance and result accuracy.

Hybrid Attention Cascaded U-net for Building Extraction from Aerial Images

HA U-Net: Improved Model for Building Extraction From High Resolution Remote Sensing Imagery

Attention-Gate-Based Encoder–Decoder Network for Automatical Building Extraction

Building Extraction from Very High Resolution Aerial Imagery Using Joint Attention Deep Neural Network

Multi-Scale Attention Network for Building Extraction from High-Resolution Remote Sensing Images

Arc-Net: An Efficient Network For Building Extraction From High-Resolution Aerial Images

Multi-Scale Feature Fusion Attention Network for Building Extraction in Remote Sensing Images

A Hybrid Attention-Aware Fusion Network (HAFNet) for Building Extraction from High-Resolution Imagery and LiDAR Data

A Cascaded Network With Coupled High-Low Frequency Features for Building Extraction

Efficient Building Extraction for High Spatial Resolution Images Based on Dual Attention Network

Asymmetric Network Combining CNN and Transformer for Building Extraction from Remote Sensing Images

ACMFNet: Attention-Based Cross-Modal Fusion Network for Building Extraction of Remote Sensing Images

AGs-Unet: Building Extraction Model for High Resolution Remote Sensing Images Based on Attention Gates U Network

Effective Building Extraction From High-Resolution Remote Sensing Images With Multitask Driven Deep Neural Network

EA U2-Net: An Efficient Building Extraction Algorithm Based on Complex Background Information

Urban building extraction from high-resolution remote sensing imagery based on multi-scale recurrent conditional generative adversarial network

Combining Deep Fully Convolutional Network and Graph Convolutional Neural Network for the Extraction of Buildings from Aerial Images

Building Instance Extraction Method Based on Improved Hybrid Task Cascade

FSAU-Net: a Network for Extracting Buildings from Remote Sensing Imagery Using Feature Self-Attention

Automatic Building Extraction from High-Resolution Aerial Imagery Via Fully Convolutional Encoder-Decoder Network with Non-Local Block

SCA-Net: A Multiscale Building Segmentation Network Incorporating a Dual-Attention Mechanism