Abstract:The authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—Generative Adversarial Network of Unpair Data. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Cloud removal algorithm is a crucial step of remote sensing image preprocessing. The current mainstream remote sensing image cloud removal algorithms are implemented based on deep learning, and most of them are supervised. A large number of data pairs are required for training to achieve cloud removal. However, real with/without cloud image pairs datasets are difficult to obtain in the real world, and the models obtained by training on synthetic datasets often need to generalize better to natural scenes. And the existing unsupervised thin cloud removal methods based on Cycle‐GAN framework with considerable model complexity and unstable training are not an excellent solution to the problem of lack of paired datasets. Based on this, in this paper, the authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—GAN‐UD. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Experimental results show that the proposed method in this paper can still effectively remove thin clouds from remote sensing images without paired training datasets, outperforms current unsupervised cloud removal methods, and achieves comparable performance to supervised methods.

HyA-GAN: remote sensing image cloud removal based on hybrid attention generation adversarial network

Cloud Removal for Remote Sensing Imagery via Spatial Attention Generative Adversarial Network

Cloud Removal Using SAR and Optical Images Via Attention Mechanism-Based GAN

Multi-Head Linear Attention Generative Adversarial Network for Thin Cloud Removal

Dehaze-AGGAN: Unpaired Remote Sensing Image Dehazing Using Enhanced Attention-Guide Generative Adversarial Networks.

AFFNet: Attention Mechanism Network Based on Fusion Feature for Image Cloud Removal

Cloud Removal for Optical Remote Sensing Imagery Using Distortion Coding Network Combined with Compound Loss Functions

Thin Cloud Removal Generative Adversarial Network Based on Sparse Transformer in Remote Sensing Images

Single Image Thin Cloud Removal for Remote Sensing Images Based on Conditional Generative Adversarial Nets

Cloud-Aware Generative Network: Removing Cloud From Optical Remote Sensing Images

Attention Mechanism-Based Generative Adversarial Networks for Cloud Removal in Landsat Images

Selecting Information Fusion Generative Adversarial Network for Remote-Sensing Image Cloud Removal

DeCloud GAN: An Advanced Generative Adversarial Network for Removing Cloud Cover in Optical Remote Sensing Imagery

Residual Group Enhanced GAN for Remote Sensing Image Cloud Shadow Removal

Assessment of generative adversarial networks for cloud occlusion removal on remotely sensed images

Remote sensing image dehazing using generative adversarial network with texture and color space enhancement

MM811 Project Report: Cloud Detection and Removal in Satellite Images

Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation

Attentive Contextual Attention for Cloud Removal

DC-GAN with Feature Attention for Single Image Dehazing

Unsupervised remote sensing image thin cloud removal method based on contrastive learning