Abstract:Building footprint extraction is a basic task in the fields of mapping, image understanding, computer vision, and so on. Accurately and efficiently extracting building footprints from a wide range of remote sensed imagery remains a challenge due to the complex structures, variety of scales, and diverse appearances of buildings. Existing convolutional neural network (CNN)-based building extraction methods are criticized for their inability to detect tiny buildings because the spatial information of CNN feature maps is lost during repeated pooling operations of the CNN. In addition, large buildings still have inaccurate segmentation edges. Moreover, features extracted by a CNN are always partially restricted by the size of the receptive field, and large-scale buildings with low texture are always discontinuous and holey when extracted. To alleviate these problems, multiscale strategies are introduced in the latest research works to extract buildings with different scales. The features with higher resolution generally extracted from shallow layers, which extracted insufficient semantic information for tiny buildings. This article proposes a novel multiple attending path neural network (MAP-Net) for accurately extracting multiscale building footprints and precise boundaries. Unlike existing multiscale feature extraction strategies, MAP-Net learns spatial localization-preserved multiscale features through a multiparallel path in which each stage is gradually generated to extract high-level semantic features with fixed resolution. Then, an attention module adaptively squeezes the channel-wise features extracted from each path for optimized multiscale fusion, and a pyramid spatial pooling module captures global dependence for refining discontinuous building footprints. Experimental results show that our method achieved 0.88%, 0.93%, and 0.45% F1-score and 1.53%, 1.50%, and 0.82% intersection over union (IoU) score improvements without increasing computational complexity compared with the latest HRNetv2 on the Urban 3-D, Deep Globe, and WHU data sets, respectively. Specifically, MAP-Net outperforms multiscale aggregation fully convolutional network (MA-FCN), which is the state-of-the-art (SOTA) algorithms with postprocessing and model voting strategies, on the WHU data set without pretraining and postprocessing. The TensorFlow implementation is available at https://github.com/lehaifeng/MAPNet.

Web-Net: A Novel Nest Networks With Ultra-Hierarchical Sampling For Building Extraction From Aerial Imageries

Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network

Hierarchical Disentangling Network for Building Extraction from Very High Resolution Optical Remote Sensing Imagery

Building NAS: Automatic Designation of Efficient Neural Architectures for Building Extraction in High-Resolution Aerial Images.

HA U-Net: Improved Model for Building Extraction From High Resolution Remote Sensing Imagery

A Lightweight Network for Building Extraction from Remote Sensing Images

A Cascaded Network With Coupled High-Low Frequency Features for Building Extraction

SDSNet: Building Extraction in High-Resolution Remote Sensing Images Using a Deep Convolutional Network with Cross-Layer Feature Information Interaction Filtering

UANet: An Uncertainty-Aware Network for Building Extraction From Remote Sensing Images

B-FGC-Net: A Building Extraction Network from High Resolution Remote Sensing Imagery

U-Net: A Smart Application with Multidimensional Attention Network for Remote Sensing Images

DR-Net: An Improved Network for Building Extraction from High Resolution Remote Sensing Image

Arc-Net: An Efficient Network For Building Extraction From High-Resolution Aerial Images

SAU-Net: a Novel Network for Building Extraction from High-Resolution Remote Sensing Images by Reconstructing Fine-Grained Semantic Features

EA U2-Net: An Efficient Building Extraction Algorithm Based on Complex Background Information

E-D-Net: Automatic Building Extraction from High-Resolution Aerial Images with Boundary Information

HD-Net: High-resolution decoupled network for building footprint extraction via deeply supervised body and boundary decomposition

MAP-Net: Multiple Attending Path Neural Network for Building Footprint Extraction from Remote Sensed Imagery

Automatic Building Extraction from High-Resolution Aerial Imagery Via Fully Convolutional Encoder-Decoder Network with Non-Local Block

Building Extraction From Very High-Resolution Remote Sensing Images Using Refine-UNet

A Deep Residual Learning Serial Segmentation Network for Extracting Buildings from Remote Sensing Imagery