Abstract:Building footprints and road networks are important inputs for a great deal of services. For instance, building maps are useful for urban planning, whereas road maps are essential for disaster response services. Traditionally, building and road maps are manually generated by remote sensing experts or land surveying, occasionally assisted by semi-automatic tools. In the last decade, deep learning-based approaches have demonstrated their capabilities to extract these elements automatically and accurately from remote sensing imagery. The building footprint and road network detection problem can be considered a multi-class semantic segmentation task, that is, a single model performs a pixel-wise classification on multiple classes, optimizing the overall performance. However, depending on the spatial resolution of the imagery used, both classes may coexist within the same pixel, drastically reducing their separability. In this regard, binary decomposition techniques, which have been widely studied in the machine learning literature, are proved useful for addressing multi-class problems. Accordingly, the multi-class problem can be split into multiple binary semantic segmentation sub-problems, specializing different models for each class. Nevertheless, in these cases, an aggregation step is required to obtain the final output labels. Additionally, other novel approaches, such as multi-task learning, may come in handy to further increase the performance of the binary semantic segmentation models. Since there is no certainty as to which strategy should be carried out to accurately tackle a multi-class remote sensing semantic segmentation problem, this paper performs an in-depth study to shed light on the issue. For this purpose, open-access Sentinel-1 and Sentinel-2 imagery (at 10 m) are considered for extracting buildings and roads, making use of the well-known U-Net convolutional neural network. It is worth stressing that building and road classes may coexist within the same pixel when working at such a low spatial resolution, setting a challenging problem scheme. Accordingly, a robust experimental study is developed to assess the benefits of the decomposition strategies and their combination with a multi-task learning scheme. The obtained results demonstrate that decomposing the considered multi-class remote sensing semantic segmentation problem into multiple binary ones using a One-vs.-All binary decomposition technique leads to better results than the standard direct multi-class approach. Additionally, the benefits of using a multi-task learning scheme for pushing the performance of binary segmentation models are also shown.

MSegnet, a Practical Network for Building Detection from High Spatial Resolution Images

Multi-scale Edge Constrained for Building Semantic Segmentation Using High Resolution Remote Sensing Images

Efficient Multi-scale Network for Semantic Segmentation of fine-Resolution Remotely Sensed Images

HCRB-MSAN: Horizontally Connected Residual Blocks-Based Multiscale Attention Network for Semantic Segmentation of Buildings in HSR Remote Sensing Images

Multi-scale attention integrated hierarchical networks for high-resolution building footprint extraction

MSFTrans: a multi-task frequency-spatial learning transformer for building extraction from high spatial resolution remote sensing images

Method of Building Detection in Optical Remote Sensing Images Based on SegFormer

Semantic Segmentation Network Combined with Edge Detection for Building Extraction in Remote Sensing Images

Multi-scale Spatial Aggregation Network for Remote Sensing Image Segmentation

A Deep Residual Learning Serial Segmentation Network for Extracting Buildings from Remote Sensing Imagery

Deep Learning based Semantic Segmentation for Buildings Detection from Remote Sensing Images

Building Extraction of Aerial Images by a Global and Multi-Scale Encoder-Decoder Network

Multi-Class Strategies for Joint Building Footprint and Road Detection in Remote Sensing

Multi-Level Perceptual Network for Urban Building Extraction from High-Resolution Remote Sensing Images

New Building Extraction Method Based on Semantic Segmentation

Semi-Supervised Adversarial Semantic Segmentation Network Using Transformer and Multiscale Convolution for High-Resolution Remote Sensing Imagery

BUILDING SECTION INSTANCE SEGMENTATION WITH COMBINED CLASSICAL AND DEEP LEARNING METHODS

Multi-Scale Feature Fusion Attention Network for Building Extraction in Remote Sensing Images

Scale-Aware Neural Network for Semantic Segmentation of Multi-Resolution Remote Sensing Images

Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network

SSDBN: A Single-Side Dual-Branch Network with Encoder–Decoder for Building Extraction