Abstract:<p>Cloud cover is a common and inevitable phenomenon that often hinders the usability of optical remote sensing (RS) image data and further interferes with continuous cartography based on RS image interpretation. In the literature, the off-the-shelf cloud detection methods either require various hand-crafted features or utilize data-driven features using deep networks. Overall, deep networks achieve much better performance than traditional methods using hand-crafted features. However, the current deep networks used for cloud detection depend on massive pixel-level annotation labels, which require a great deal of manual annotation labor. To reduce the labor needed for annotating the pixel-level labels, this paper proposes a weakly supervised deep learning-based cloud detection (WDCD) method using block-level labels indicating only the presence or the absence of cloud in one RS image block. In the training phase, a new global convolutional pooling (GCP) operation is proposed to enhance the ability of the feature map to represent useful information (e.g., spatial variance). In the testing phase, the trained deep networks are modified to generate the cloud activation map (CAM) via the local pooling pruning (LPP) strategy, which prunes the local pooling layers of the deep networks that are trained in the training phase to improve the quality (e.g., spatial resolution) of CAM. One large RS image is cropped into multiple overlapping blocks by a sliding window, and then the CAM of each block is generated by the modified deep networks. Based on the correspondence between the image blocks and CAMs, multiple corresponding CAMs are collected to mosaic the CAM of the large image. By segmenting the CAM using a statistical threshold against a clear-sky surface, the pixel-level cloud mask of the testing image can be obtained. To verify the effectiveness of our proposed WDCD method, we collected a new global dataset, for which the training dataset contains over 200,000 RS image blocks with block-level labels from 622 large GaoFen-1 images from all over the world; the validation dataset contains 5 large GaoFen-1 images with pixel-level annotation labels, and the testing dataset contains 25 large GaoFen-1 and ZiYuan-3 images with pixel-level annotation labels. Even under the extremely weak supervision, our proposed WDCD method could achieve excellent cloud detection performance with an overall accuracy (OA) as high as 96.66%. Extensive experiments demonstrated that our proposed WDCD method obviously outperforms the state-of-the-art methods. The collected datasets have been made publicly available online (<a href="https://github.com/weichenrs/WDCD">https://github.com/weichenrs/WDCD</a>).</p>

Self-Attentive Generative Adversarial Network for Cloud Detection in High Resolution Remote Sensing Images

A hybrid generative adversarial network for weakly-supervised cloud detection in multispectral images

A Novel Spectral Indices-Driven Spectral-Spatial-Context Attention Network for Automatic Cloud Detection

Semi-Supervised Cloud Detection for Remote Sensing Imagery Via Self-Training

A Cloud Detection Method Using Convolutional Neural Network Based on Gabor Transform and Attention Mechanism with Dark Channel Subnet for Remote Sensing Image

Cloud Detection Algorithm for Multi-Satellite Remote Sensing Imagery Based on a Spectral Library and 1D Convolutional Neural Network

Discriminative Feature Learning Constrained Unsupervised Network for Cloud Detection in Remote Sensing Imagery.

Cloud Detection Method Using CNN Based on Cascaded Feature Attention and Channel Attention

Attention GANs: Unsupervised Deep Feature Learning for Aerial Scene Classification.

Cloud-Aware Generative Network: Removing Cloud From Optical Remote Sensing Images

Optical Remote Sensing Image Cloud Detection with Self-Attention and Spatial Pyramid Pooling Fusion

Accurate cloud detection in high-resolution remote sensing imagery by weakly supervised deep learning

Cloud Removal for Remote Sensing Imagery via Spatial Attention Generative Adversarial Network

GS–CDNet: a remote sensing image cloud detection method with geographic spatial data integration

Attention Mechanism-Based Generative Adversarial Networks for Cloud Removal in Landsat Images

An Automatic Cloud Detection Neural Network for High-Resolution Remote Sensing Imagery With Cloud–Snow Coexistence

AMCD-Net: An Effective Attention-Aided Multilevel Cloud Detection Network for Optical Satellite Imagery

Cloud Detection Method Using Convolutional Neural Network Based on Cascaded Color and Texture Feature Attention

Unsupervised remote sensing image thin cloud removal method based on contrastive learning

CNN Cloud Detection Algorithm Based on Channel and Spatial Attention and Probabilistic Upsampling for Remote Sensing Image

Convolutional Neural Network-Driven Improvements in Global Cloud Detection for Landsat 8 and Transfer Learning on Sentinel-2 Imagery