Abstract:Clouds are one of the major limitations to crop monitoring using optical satellite images. Despite all efforts to provide decision-makers with high-quality agricultural statistics, there is still a lack of techniques to optimally process satellite image time series in the presence of clouds. In this regard, in this article it was proposed to add a Multi-Layer Perceptron loss function to the pix2pix conditional Generative Adversarial Network (cGAN) objective function. The aim was to enforce the generative model to learn how to deliver synthetic pixels whose values were proxies for the spectral response improving further crop type mapping. Furthermore, it was evaluated the generalization capacity of the generative models in producing pixels with plausible values for images not used in the training. To assess the performance of the proposed approach it was compared real images with synthetic images generated with the proposed approach as well as with the original pix2pix cGAN. The comparative analysis was performed through visual analysis, pixel values analysis, semantic segmentation and similarity metrics. In general, the proposed approach provided slightly better synthetic pixels than the original pix2pix cGAN, removing more noise than the original pix2pix algorithm as well as providing better crop type semantic segmentation; the semantic segmentation of the synthetic image generated with the proposed approach achieved an F1-score of 44.2%, while the real image achieved 44.7%. Regarding the generalization, the models trained utilizing different regions of the same image provided better pixels than models trained using other images in the time series. Besides this, the experiments also showed that the models trained using a pair of images selected every three months along the time series also provided acceptable results on images that do not have cloud-free areas.

Univariate Time Series missing data Imputation using Pix2Pix GAN

A data imputation method for multivariate time series based on generative adversarial network.

A time series continuous missing values imputation method based on generative adversarial networks

Multivariate Time Series Missing Value Filling Based on Trans-GAN Model

A Missing Data Imputation GAN for Character Sprite Generation

Generative Semi-supervised Learning for Multivariate Time Series Imputation

Parallel Generative Adversarial Imputation Network for Multivariate Missing Time-Series Reconstruction and Its Application to Aeroengines

Probabilistic Imputation for Time-series Classification with Missing Data

MBGAN: An improved generative adversarial network with multi-head self-attention and bidirectional RNN for time series imputation

Multiple Imputation with Denoising Autoencoder using Metamorphic Truth and Imputation Feedback

Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networks

Long-Term Missing Value Imputation for Time Series Data Using Deep Neural Networks

Networked Time-series Prediction with Incomplete Data via Generative Adversarial Network

CM-GAN: A Cross-Modal Generative Adversarial Network for Imputing Completely Missing Data in Digital Industry

Pix2pix Conditional Generative Adversarial Network with MLP Loss Function for Cloud Removal in a Cropland Time Series

Reconstruction of irregular missing seismic data using conditional generative adversarial networks

Imputation of Missing Data with Class Imbalance using Conditional Generative Adversarial Networks

Time-series Imputation and Prediction with Bi-Directional Generative Adversarial Networks

Missing Features Reconstruction Using a Wasserstein Generative Adversarial Imputation Network

Improved generative adversarial imputation networks for missing data

Multi-feature generation network-based imputation method for industrial data with high missing rate