Abstract:Building extraction from high-resolution images has been a fundamental task in the remote sensing field. It helps in monitoring natural disasters and developing urban areas. Encoder–Decoder based convolutional neural network (CNN) has provided a paradigm for automatic building extraction. However, extracting building information is difficult due to many reasons like diverse scales, complex background and variety of building structures. Moreover, achieving accurate boundary information remains challenging due to various impediments surrounding buildings. To deal with these challenges, in this article, we proposed a dual-branch model. One branch is the segmentation branch that includes an encoder–decoder framework (based on Attention-ResUNet architecture) combining residual unit and attention network, to generate the segmentation mask. The residual unit improves the ability to learn the deep and complex building features whereas the attention network focuses on the informative spatial information. In addition, a dilated module is positioned at the end of the decoder of Attention-ResUNet to capture the multiscale information. Another branch is the edge branch consisting of canny edge extraction, morphological operation and squeeze-excitation network, to improve the boundary information. The canny edge detection method extracts the edges of the buildings which is further enhanced through the morphological operation. In addition, a squeeze-excitation network is added for fine adjustment of generated feature maps. At the end, our proposed model integrates the segmentation mask obtained using the segmentation branch and boundary information generated by the edge branch to produce the refined segmentation mask. Experiments have been performed on the Massachusetts building dataset and the WHU-I building dataset. The performance of proposed model is compared with state-of-the-art models such as SegNet, DeepLabV3Plus, UNet, Attention-UNet, ResUNet and Attention-ResUNet. The results demonstrate that the proposed approach improves the performance for both the datasets. Hence, we can conclude that the proposed approach has a great potential in extracting multiscale information and enhancing the boundary information of buildings.

SSDBN: A Single-Side Dual-Branch Network with Encoder–Decoder for Building Extraction

Improved Building Extraction from Remotely Sensed Images by Integration of Encode–Decoder and Edge Enhancement Models

SPNet: Dual-Branch Network with Spatial Supplementary Information for Building and Water Segmentation of Remote Sensing Images

HCRB-MSAN: Horizontally Connected Residual Blocks-Based Multiscale Attention Network for Semantic Segmentation of Buildings in HSR Remote Sensing Images

Attention-Gate-Based Encoder–Decoder Network for Automatical Building Extraction

SDSNet: Building Extraction in High-Resolution Remote Sensing Images Using a Deep Convolutional Network with Cross-Layer Feature Information Interaction Filtering

A Deep Residual Learning Serial Segmentation Network for Extracting Buildings from Remote Sensing Imagery

A Dual-Branch Fusion Network Based on Reconstructed Transformer for Building Extraction in Remote Sensing Imagery

Architecture of Deep Convolutional Encoder-Decoder Networks for Building Footprint Semantic Segmentation

Extracting Buildings from Remote Sensing Images Using a Multitask Encoder-Decoder Network with Boundary Refinement

NPSFF-Net: Enhanced Building Segmentation in Remote Sensing Images via Novel Pseudo-Siamese Feature Fusion

Building Extraction of Aerial Images by a Global and Multi-Scale Encoder-Decoder Network

Building Extraction from High-Resolution Remote-Sensing Images Based on Deep Learning

Semantics and Contour Based Interactive Learning Network for Building Footprint Extraction

DESENet: a bilateral network with detail-enhanced semantic encoder for real-time semantic segmentation

Automatic Building Extraction from High-Resolution Aerial Imagery Via Fully Convolutional Encoder-Decoder Network with Non-Local Block

Efficient Parallel Multi-Scale Detail and Semantic Encoding Network for Lightweight Semantic Segmentation

Semantic Segmentation Network Combined with Edge Detection for Building Extraction in Remote Sensing Images

BSSNet:A Real-Time Semantic Segmentation Network for Road Scenes Inspired from AutoEncoder

Dual-Stream Feature Extraction Network Based on CNN and Transformer for Building Extraction

Building Extraction From High Spatial Resolution Remote Sensing Images of Complex Scenes by Combining Region-Line Feature Fusion and OCNN