Abstract:The authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—Generative Adversarial Network of Unpair Data. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Cloud removal algorithm is a crucial step of remote sensing image preprocessing. The current mainstream remote sensing image cloud removal algorithms are implemented based on deep learning, and most of them are supervised. A large number of data pairs are required for training to achieve cloud removal. However, real with/without cloud image pairs datasets are difficult to obtain in the real world, and the models obtained by training on synthetic datasets often need to generalize better to natural scenes. And the existing unsupervised thin cloud removal methods based on Cycle‐GAN framework with considerable model complexity and unstable training are not an excellent solution to the problem of lack of paired datasets. Based on this, in this paper, the authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—GAN‐UD. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Experimental results show that the proposed method in this paper can still effectively remove thin clouds from remote sensing images without paired training datasets, outperforms current unsupervised cloud removal methods, and achieves comparable performance to supervised methods.

Attention Mechanism-Based Generative Adversarial Networks for Cloud Removal in Landsat Images

Cloud Removal Using SAR and Optical Images Via Attention Mechanism-Based GAN

Cloud Removal for Remote Sensing Imagery via Spatial Attention Generative Adversarial Network

Multi-Head Linear Attention Generative Adversarial Network for Thin Cloud Removal

Attentive Contextual Attention for Cloud Removal

Cloud-Aware Generative Network: Removing Cloud From Optical Remote Sensing Images

Single Image Thin Cloud Removal for Remote Sensing Images Based on Conditional Generative Adversarial Nets

AFFNet: Attention Mechanism Network Based on Fusion Feature for Image Cloud Removal

Thin cloud removal in optical remote sensing images based on generative adversarial networks and physical model of cloud distortion

Cloud Removal with Fusion of High Resolution Optical and SAR Images Using Generative Adversarial Networks

HyA-GAN: remote sensing image cloud removal based on hybrid attention generation adversarial network

Algorithm for cloud removal in optical-synthetic aperture radar fusion images based on improved residual networks

Thick Cloud Removal Under Land Cover Changes Using Multisource Satellite Imagery and a Spatiotemporal Attention Network

Cloud Removal for Optical Remote Sensing Imagery Using Distortion Coding Network Combined with Compound Loss Functions

Unsupervised remote sensing image thin cloud removal method based on contrastive learning

Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation

Transformer Meets GAN: Cloud-Free Multispectral Image Reconstruction via Multisensor Data Fusion in Satellite Images

Gated Convolutional Networks for Cloud Removal From Bi-Temporal Remote Sensing Images

LGE-CR: Integrating Nonlocal Gated Attention and Two-Flow Residual Dense Learning for Cloud Removal

Selecting Information Fusion Generative Adversarial Network for Remote-Sensing Image Cloud Removal