Abstract:Cloud cover is a phenomenon that inevitably exists in remote sensing images, and ground information is lost due to the presence of clouds. To a large extent, it causes degradation of the remote sensing image quality. Therefore, the detection of clouds in remote sensing images is the foundation and key to further emphasizing and use of remote sensing image information. To tackle the question of misjudgment, omission, and long training time of current deep learning-based cloud detection methods, this article suggests an improved cloud detection method for remote sensing images with a deeplabV3+ network. The method aims to detect cloud-covered regions in remote sensing images more accurately, quickly and efficiently. The training time is reduced by improving the Xception backbone network to reduce the amount of parameters; the improved CBAM module is added after the Atrous Spatial Pyramid Pooling (ASPP) module to strengthen the sensory field to better capture the contextual information; and the GAU module is used to replace the traditional bilinear interpolation up-sampling in the decoder part, which results in a better quality of the up-sampling, more spatial sense of the fusion, and improved accuracy of the segmentation. Experiments were conducted by using datasets from the homegrown ZY-03 satellite and comparing them with traditional DeeplabV3+, MobileNet and U-Net. And the generalization ability is verified using the public Sentinal-2 dataset. Compared to legacy deeplabV3+ networks, the accuracy rate is improved by 3.91%, the improved precision by 3.12%, the improved recall by 2.78%, and the improved Mean Intersection over Union (MIoU) by 5.75%. Compared to Mobilenet, the improved accuracy by 1.79%, the improved precision by 1.47%, the improved recall by 1.42%, and the improved Mean Intersection over Union (MIoU) by 4.15%. Compared with the Unet network, the improved accuracy by 1.28%, the improved precision by 1.36%, the improved recall by 1.32%, and the improved Mean Intersection over Union (MIoU) by 3.36%. The method presented in this article demonstrates superior performance in cloud detection compared to several other networks.

A Novel Ground-Based Cloud Image Segmentation Method by Using Deep Transfer Learning

CloudU-Netv2: A Cloud Segmentation Method for Ground-Based Cloud Images Based on Deep Learning

SegCloud: a Novel Cloud Image Segmentation Model Using a Deep Convolutional Neural Network for Ground-Based All-Sky-view Camera Observation

CloudDeepLabV3+: a lightweight ground-based cloud segmentation method based on multi-scale feature aggregation and multi-level attention feature enhancement

Multi-label Cloud Segmentation Using a Deep Network

CloudY-Net: A Deep Convolutional Neural Network Architecture for Joint Segmentation and Classification of Ground-Based Cloud Images

CloudSegNet: A Deep Network for Nychthemeron Cloud Image Segmentation

Cloud and cloud shadow detection in Landsat imagery based on deep convolutional neural networks

Cloud Detection Method Based on Improved DeeplabV3+ Remote Sensing Image

TransCloudSeg: Ground-Based Cloud Image Segmentation with Transformer

CloudU-Net: A Deep Convolutional Neural Network Architecture for Daytime and Nighttime Cloud Images’ Segmentation

Annotated Dataset for Training Cloud Segmentation Neural Networks Using High-Resolution Satellite Remote Sensing Imagery

A deep learning based framework for remote sensing image ground object segmentation

GS–CDNet: a remote sensing image cloud detection method with geographic spatial data integration

CloudFU-Net: A Fine-Grained Segmentation Method for Ground-Based Cloud Images Based on an Improved Encoder–Decoder Structure

End-to-end Cloud Segmentation in High-Resolution Multispectral Satellite Imagery Using Deep Learning

CloudDenseNet: Lightweight Ground-Based Cloud Classification Method for Large-Scale Datasets Based on Reconstructed DenseNet

ACLNet: An Attention and Clustering-based Cloud Segmentation Network

A Cloud Detection Method Using Convolutional Neural Network Based on Gabor Transform and Attention Mechanism with Dark Channel Subnet for Remote Sensing Image

Ground‐Based Cloud Classification Using Task‐Based Graph Convolutional Network

BenchCloudVision: A Benchmark Analysis of Deep Learning Approaches for Cloud Detection and Segmentation in Remote Sensing Imagery