Abstract:Cloud detection is a prerequisite for optical remote sensing applications due to the ubiquitous cloud coverage and negative effect of cloud occlusions. However, it is very challenging because of the heterogeneity of clouds and diversity of underlying surfaces, especially for thin clouds with illegible shapes and dispersed distribution in addition to high transparency, which is a common bottleneck for most methods. To tackle these problems, this article proposes an innovative attention-aided multilevel cloud detection network (AMCD-Net) for optical satellite imagery. Specifically, AMCD-Net takes full account of the variability and complexity of clouds and integrates multilevel features and different attentions within a deep convolutional U-Net framework, thus enabling more accurate cloud identification in complex scenarios. On the one hand, a multilevel asymmetric convolutional (MAC) module embedded encoder is established to learn discriminative representations for clouds with various shapes and integrate the complementarity of multilevel features to improve model robustness, with a regional attention-based decoder constructed to more accurately recover complicated cloud distribution, which effectively balances the integrity and details of clouds. On the other hand, a deformable convolution-based geometry enhancement attention (GEA) is designed to refine information transmission between the encoder and the decoder, with a joint loss of binary cross-entropy (BCE) and structural similarity index (SSIM) constructed to simultaneously focus on category and morphology discriminant excavation, which are favorable for fine-grained cloud prediction. The effectiveness of AMCD-Net was verified on two well-known datasets, i.e., the 38-Cloud dataset and the SPARCS dataset, and the results demonstrate that it outperformed the other state-of-the-art deep networks.

Cloud Detection Method Using CNN Based on Cascaded Feature Attention and Channel Attention

Cloud Detection Method Using Convolutional Neural Network Based on Cascaded Color and Texture Feature Attention

CNN Cloud Detection Algorithm Based on Channel and Spatial Attention and Probabilistic Upsampling for Remote Sensing Image

A Cloud Detection Method Using Convolutional Neural Network Based on Gabor Transform and Attention Mechanism with Dark Channel Subnet for Remote Sensing Image

Detail-Aware Multiscale Context Fusion Network for Cloud Detection

CD-CTFM: A Lightweight CNN-Transformer Network for Remote Sensing Cloud Detection Fusing Multiscale Features

Cloud Detection in Remote Sensing Images Based on Multiscale Features-Convolutional Neural Network

An Effective Cloud Detection Method for Gaofen-5 Images via Deep Learning

Attention Mechanism Cloud Detection With Modified FCN for Infrared Remote Sensing Images

Channel Attention Cloud Detection Network for Ground-Based Cloud Detection

AMCD-Net: An Effective Attention-Aided Multilevel Cloud Detection Network for Optical Satellite Imagery

Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors

Super-pixel cloud detection using Hierarchical Fusion CNN

Attention Mechanism with Spatial Spectrum Dense Connection and Context Dynamic Convolution for Cloud Detection.

CDnet: CNN-Based Cloud Detection for Remote Sensing Imagery

Cloud Detection Method Based on Spatial–Spectral Features and Encoder–Decoder Feature Fusion

Automatic cloud detection method for optical remote sensing images combining channel attention mechanism and multi-feature fusion

Cloud Detection Of Remote Sensing Images By Deep Learning

Controllably Deep Supervision and Multi-Scale Feature Fusion Network for Cloud and Snow Detection Based on Medium- and High-Resolution Imagery Dataset