Abstract:The authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—Generative Adversarial Network of Unpair Data. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Cloud removal algorithm is a crucial step of remote sensing image preprocessing. The current mainstream remote sensing image cloud removal algorithms are implemented based on deep learning, and most of them are supervised. A large number of data pairs are required for training to achieve cloud removal. However, real with/without cloud image pairs datasets are difficult to obtain in the real world, and the models obtained by training on synthetic datasets often need to generalize better to natural scenes. And the existing unsupervised thin cloud removal methods based on Cycle‐GAN framework with considerable model complexity and unstable training are not an excellent solution to the problem of lack of paired datasets. Based on this, in this paper, the authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—GAN‐UD. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Experimental results show that the proposed method in this paper can still effectively remove thin clouds from remote sensing images without paired training datasets, outperforms current unsupervised cloud removal methods, and achieves comparable performance to supervised methods.

Variational mode decomposition-enhanced thin cloud removal using UNet vision transformer cycle-consistent generative adversarial network

Thin cloud removal in optical remote sensing images based on generative adversarial networks and physical model of cloud distortion

Thin Cloud Removal Generative Adversarial Network Based on Sparse Transformer in Remote Sensing Images

Thin Cloud Removal for Remote Sensing Images Using a Physical-Model-Based CycleGAN With Unpaired Data

Unsupervised remote sensing image thin cloud removal method based on contrastive learning

DeCloud GAN: An Advanced Generative Adversarial Network for Removing Cloud Cover in Optical Remote Sensing Imagery

Thin Cloud Removal for Multispectral Remote Sensing Images Using Convolutional Neural Networks Combined With an Imaging Model

Transformer Meets GAN: Cloud-Free Multispectral Image Reconstruction via Multisensor Data Fusion in Satellite Images

Cloud Removal with Fusion of High Resolution Optical and SAR Images Using Generative Adversarial Networks

Study Model for Information Reconstruction on Cloud Contaminated Area for Single Multispectral Remote Sensing Sentinel-2 Imagery using Generative Adversarial Network

Gated Convolutional Networks for Cloud Removal From Bi-Temporal Remote Sensing Images

Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation

An Innovative Approach for Effective Removal of Thin Clouds in Optical Images Using Convolutional Matting Model

Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets

Cloud-Aware Generative Network: Removing Cloud From Optical Remote Sensing Images

Deep neural networks for removing clouds and nebulae from satellite images

Wavelet Integrated Convolutional Neural Network for Thin Cloud Removal in Remote Sensing Images

Cloud Removal for Optical Remote Sensing Imagery Using Distortion Coding Network Combined with Compound Loss Functions

Cloudmaskgan: A Content-Aware Unpaired Image-To-Image Translation Algorithm for Remote Sensing Imagery