Abstract:Urban building segmentation is a prevalent research domain for very high resolution (VHR) remote sensing; however, various appearances and complicated background of VHR remote sensing imagery make accurate semantic segmentation of urban buildings a challenge in relevant applications. Following the basic architecture of U-Net, an end-to-end deep convolutional neural network (denoted as DeepResUnet) was proposed, which can effectively perform urban building segmentation at pixel scale from VHR imagery and generate accurate segmentation results. The method contains two sub-networks: One is a cascade down-sampling network for extracting feature maps of buildings from the VHR image, and the other is an up-sampling network for reconstructing those extracted feature maps back to the same size of the input VHR image. The deep residual learning approach was adopted to facilitate training in order to alleviate the degradation problem that often occurred in the model training process. The proposed DeepResUnet was tested with aerial images with a spatial resolution of 0.075 m and was compared in performance under the exact same conditions with six other state-of-the-art networks—FCN-8s, SegNet, DeconvNet, U-Net, ResUNet and DeepUNet. Results of extensive experiments indicated that the proposed DeepResUnet outperformed the other six existing networks in semantic segmentation of urban buildings in terms of visual and quantitative evaluation, especially in labeling irregular-shape and small-size buildings with higher accuracy and entirety. Compared with the U-Net, the F1 score, Kappa coefficient and overall accuracy of DeepResUnet were improved by 3.52%, 4.67% and 1.72%, respectively. Moreover, the proposed DeepResUnet required much fewer parameters than the U-Net, highlighting its significant improvement among U-Net applications. Nevertheless, the inference time of DeepResUnet is slightly longer than that of the U-Net, which is subject to further improvement.

CloudU-Net: A Deep Convolutional Neural Network Architecture for Daytime and Nighttime Cloud Images’ Segmentation

CloudY-Net: A Deep Convolutional Neural Network Architecture for Joint Segmentation and Classification of Ground-Based Cloud Images

CloudSegNet: A Deep Network for Nychthemeron Cloud Image Segmentation

CloudFU-Net: A Fine-Grained Segmentation Method for Ground-Based Cloud Images Based on an Improved Encoder–Decoder Structure

3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Multi-label Cloud Segmentation Using a Deep Network

CloudDeepLabV3+: a lightweight ground-based cloud segmentation method based on multi-scale feature aggregation and multi-level attention feature enhancement

Automatic Cloud Segmentation Based on Fused Fully Convolutional Networks.

Remote Sensing Image Cloud Detection Using a Shallow Convolutional Neural Network

DeepUNet: A Deep Fully Convolutional Network for Pixel-Level Sea-Land Segmentation

U-High resolution network (U-HRNet): cloud detection with high-resolution representations for geostationary satellite imagery

CRSNet: Cloud and Cloud Shadow Refinement Segmentation Networks for Remote Sensing Imagery

Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network

QualityNet: Segmentation Quality Evaluation with Deep Convolutional Networks.

U-Net for Satellite Image Segmentation: Improving the Weather Forecasting

Cloud and cloud shadow detection in Landsat imagery based on deep convolutional neural networks

A novel Deep Structure U-Net for Sea-Land Segmentation in Remote Sensing Images

Effective Detection of Cloud Masks in Remote Sensing Images

CDUNet: Cloud Detection UNet for Remote Sensing Imagery

UATNet: U-Shape Attention-Based Transformer Net for Meteorological Satellite Cloud Recognition