Abstract:The authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—Generative Adversarial Network of Unpair Data. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Cloud removal algorithm is a crucial step of remote sensing image preprocessing. The current mainstream remote sensing image cloud removal algorithms are implemented based on deep learning, and most of them are supervised. A large number of data pairs are required for training to achieve cloud removal. However, real with/without cloud image pairs datasets are difficult to obtain in the real world, and the models obtained by training on synthetic datasets often need to generalize better to natural scenes. And the existing unsupervised thin cloud removal methods based on Cycle‐GAN framework with considerable model complexity and unstable training are not an excellent solution to the problem of lack of paired datasets. Based on this, in this paper, the authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—GAN‐UD. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Experimental results show that the proposed method in this paper can still effectively remove thin clouds from remote sensing images without paired training datasets, outperforms current unsupervised cloud removal methods, and achieves comparable performance to supervised methods.

Cloud removal from satellite imagery using multispectral edge-filtered conditional generative adversarial networks

Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets

Cloud Removal for Remote Sensing Imagery via Spatial Attention Generative Adversarial Network

Cloud-Aware Generative Network: Removing Cloud From Optical Remote Sensing Images

Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation

Deep neural networks for removing clouds and nebulae from satellite images

Cloud Removal for Optical Remote Sensing Imagery Using Distortion Coding Network Combined with Compound Loss Functions

Cloud Removal with Fusion of High Resolution Optical and SAR Images Using Generative Adversarial Networks

Transformer Meets GAN: Cloud-Free Multispectral Image Reconstruction via Multisensor Data Fusion in Satellite Images

DeCloud GAN: An Advanced Generative Adversarial Network for Removing Cloud Cover in Optical Remote Sensing Imagery

A hybrid generative adversarial network for weakly-supervised cloud detection in multispectral images

Attention Mechanism-Based Generative Adversarial Networks for Cloud Removal in Landsat Images

Thin cloud removal in optical remote sensing images based on generative adversarial networks and physical model of cloud distortion

Thin Cloud Removal Generative Adversarial Network Based on Sparse Transformer in Remote Sensing Images

Unsupervised remote sensing image thin cloud removal method based on contrastive learning

HyA-GAN: remote sensing image cloud removal based on hybrid attention generation adversarial network

Pix2pix Conditional Generative Adversarial Network with MLP Loss Function for Cloud Removal in a Cropland Time Series

Points2Pix: 3D Point-Cloud to Image Translation using conditional Generative Adversarial Networks

Assessment of generative adversarial networks for cloud occlusion removal on remotely sensed images

Multi-Head Linear Attention Generative Adversarial Network for Thin Cloud Removal

GAN-Based Object Removal in High-Resolution Satellite Images