Abstract:Building extraction aims to segment building pixels from remote sensing (RS) images and plays an essential role in many applications, such as city planning and urban dynamic monitoring. Over the past few years, deep learning methods with encoder–decoder architectures have achieved remarkable performance due to their powerful feature representation capability. Nevertheless, due to the varying scales and styles of buildings, conventional deep learning models always suffer from uncertain predictions and cannot accurately distinguish the complete footprints of the building from the complex distribution of ground objects, leading to a large degree of omission and commission. In this article, we realize the importance of uncertain prediction and propose a novel and straightforward uncertainty-aware network (UANet) to alleviate this problem. Specifically, we first apply a general encoder–decoder network to obtain a building extraction map with relatively high uncertainty. Second, in order to aggregate the useful information in the highest-level features, we design a prior information guide module (PIGM) to guide the highest-level features in learning the prior information from the conventional extraction map. Third, based on the uncertain extraction map, we introduce an uncertainty rank algorithm (URA) to measure the uncertainty level of each pixel belonging to the foreground and the background. We further combine this algorithm with the proposed uncertainty-aware fusion module (UAFM) to facilitate level-by-level feature refinement and obtain the final refined extraction map with low uncertainty. To verify the performance of our proposed UANet, we conduct extensive experiments on three public building datasets, including the WHU building dataset, the Massachusetts building dataset, and the Inria aerial image dataset. Results demonstrate that the proposed UANet outperforms other state-of-the-art (SOTA) algorithms by a large margin. The source code of the proposed UANet is available at https://github.com/Henryjiepanli/Uncertainty-aware-Network.

UHA: An Intelligent Uncertainty Map Based Hierarchical Attention Network System for Building Segmentation

EHANet: Efficient Hybrid Attention Network Towards Real-time Semantic Segmentation

HA U-Net: Improved Model for Building Extraction From High Resolution Remote Sensing Imagery

HCRB-MSAN: Horizontally Connected Residual Blocks-Based Multiscale Attention Network for Semantic Segmentation of Buildings in HSR Remote Sensing Images

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

Reliable Label-Supervised Pixel Attention Mechanism for Weakly Supervised Building Segmentation in UAV Imagery

Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network

Attention Residual U-Net for Building Segmentation in Aerial Images.

UANet: An Uncertainty-Aware Network for Building Extraction From Remote Sensing Images

Hybrid Multiple Attention Network for Semantic Segmentation in Aerial Images

Building Extraction from Remote Sensing Images via an Uncertainty-Aware Network

CTMU-Net: an Improved U-Net for Semantic Segmentation of Remote-Sensing Images Based on the Combined Attention Mechanism

Hierarchical Uncertainty Estimation for Medical Image Segmentation Networks

Building Extraction From High-Resolution Aerial Imagery Using A Generative Adversarial Network With Spatial And Channel Attention Mechanisms

Instance Segmentation of Buildings from High-Resolution Remote Sensing Images with Multitask Learning

MAFF-HRNet: Multi-Attention Feature Fusion HRNet for Building Segmentation in Remote Sensing Images

Hybrid Attention Cascaded U-net for Building Extraction from Aerial Images

High-Resolution Remote Sensing Image Segmentation Algorithm Based on Improved Feature Extraction and Hybrid Attention Mechanism

ResAt-UNet: A U-Shaped Network Using ResNet and Attention Module for Image Segmentation of Urban Buildings

Hierarchical Self-Attention Embedded Neural Network With Dense Connection for Remote-Sensing Image Semantic Segmentation

Elongated Physiological Structure Segmentation via Spatial and Scale Uncertainty-aware Network