Abstract:Clouds are one of the major limitations to crop monitoring using optical satellite images. Despite all efforts to provide decision-makers with high-quality agricultural statistics, there is still a lack of techniques to optimally process satellite image time series in the presence of clouds. In this regard, in this article it was proposed to add a Multi-Layer Perceptron loss function to the pix2pix conditional Generative Adversarial Network (cGAN) objective function. The aim was to enforce the generative model to learn how to deliver synthetic pixels whose values were proxies for the spectral response improving further crop type mapping. Furthermore, it was evaluated the generalization capacity of the generative models in producing pixels with plausible values for images not used in the training. To assess the performance of the proposed approach it was compared real images with synthetic images generated with the proposed approach as well as with the original pix2pix cGAN. The comparative analysis was performed through visual analysis, pixel values analysis, semantic segmentation and similarity metrics. In general, the proposed approach provided slightly better synthetic pixels than the original pix2pix cGAN, removing more noise than the original pix2pix algorithm as well as providing better crop type semantic segmentation; the semantic segmentation of the synthetic image generated with the proposed approach achieved an F1-score of 44.2%, while the real image achieved 44.7%. Regarding the generalization, the models trained utilizing different regions of the same image provided better pixels than models trained using other images in the time series. Besides this, the experiments also showed that the models trained using a pair of images selected every three months along the time series also provided acceptable results on images that do not have cloud-free areas.

Assessment of generative adversarial networks for cloud occlusion removal on remotely sensed images

Performance evaluation of selected cloud occlusion removal algorithms on remote sensing imagery

DeCloud GAN: An Advanced Generative Adversarial Network for Removing Cloud Cover in Optical Remote Sensing Imagery

Pix2pix Conditional Generative Adversarial Network with MLP Loss Function for Cloud Removal in a Cropland Time Series

HyA-GAN: remote sensing image cloud removal based on hybrid attention generation adversarial network

Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation

Cloud Removal for Optical Remote Sensing Imagery Using Distortion Coding Network Combined with Compound Loss Functions

MM811 Project Report: Cloud Detection and Removal in Satellite Images

Cloud-Aware Generative Network: Removing Cloud From Optical Remote Sensing Images

Cloud Removal for Remote Sensing Imagery via Spatial Attention Generative Adversarial Network

Thin cloud removal in optical remote sensing images based on generative adversarial networks and physical model of cloud distortion

Thin Cloud Removal Generative Adversarial Network Based on Sparse Transformer in Remote Sensing Images

Thin Cloud Removal for Remote Sensing Images Using a Physical-Model-Based CycleGAN With Unpaired Data

Cloud removal from satellite imagery using multispectral edge-filtered conditional generative adversarial networks

Algorithm for cloud removal in optical-synthetic aperture radar fusion images based on improved residual networks

Multi-Head Linear Attention Generative Adversarial Network for Thin Cloud Removal

Study Model for Information Reconstruction on Cloud Contaminated Area for Single Multispectral Remote Sensing Sentinel-2 Imagery using Generative Adversarial Network

Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets

Cloud Removal with Fusion of High Resolution Optical and SAR Images Using Generative Adversarial Networks

Attention Mechanism-Based Generative Adversarial Networks for Cloud Removal in Landsat Images

Deep neural networks for removing clouds and nebulae from satellite images