Abstract:Pixels covered by clouds in optical Earth Observation images are not usable for most applications. For this reason, only images delivered with reliable cloud masks are eligible for an automated or massive analysis. Current state of the art cloud detection algorithms, both physical models and machine learning models, are specific to a mission or a mission type, with limited transferability. A new model has to be developed every time a new mission is launched. Machine Learning may overcome this problem and, in turn obtain state of the art, or even better performances by training a same algorithm on datasets from different missions. However, simulating products for upcoming missions is not always possible and available actual products are not enough to create a training dataset until well after the launch. Furthermore, labelling data is time consuming. Therefore, even by the time when enough data is available, manually labelled data might not be available at all.&#160;To solve this bottleneck, we propose a transfer learning based method using the available products of the current generation of satellites. These existing products are gathered in a database that is used to train a deep convolutional neural network (CNN) solely on those products. The trained model is applied to images from other - unseen - sensors and the outputs are evaluated. We avoid labelling manually by automatically producing the ground data with existing algorithms. Only a few semi-manually labelled images are used for qualifying the model. Even those semi-manually labelled samples need very few user inputs. This drastic reduction of user input limits subjectivity and reduce the costs.&#160;We provide an example of such a process by training a model to detect clouds in Sentinel-2 images, using as ground-truth the masks of existing state-of-the-art processors. Then, we apply the trained network to detect clouds in previously unseen imagery of other sensors such as the SPOT family or the High-Resolution (HR) Pleiades imaging system, which provide a different feature space.The results demonstrate that the trained model is robust to variations within the individual bands resulting from different acquisition methods and spectral responses. Furthermore, the addition of geo-located auxiliary data that is independent from the platform, such as digital elevation models (DEMs), as well as simple synthetic bands such as the NDVI or NDSI, further improves the results.In the future, this approach opens up the possibility to be used on new CNES&#8217; missions, such as Microcarb or CO3D.

Satellite imagery cloud classification based on transfer learning

Extreme Learning Machine Based Transfer Learning for Data Classification.

Research on large area cloud forecasting method based on satellite cloud images

Cross-Domain Ground-Based Cloud Classification Based on Transfer of Local Features and Discriminative Metric Learning

Convolutional Neural Network-Driven Improvements in Global Cloud Detection for Landsat 8 and Transfer Learning on Sentinel-2 Imagery

Improving future optical Earth Observation products using transfer learning

Cloud Detection Algorithm for Multi-Satellite Remote Sensing Imagery Based on a Spectral Library and 1D Convolutional Neural Network

Transfer-Learning-Based Approach to Retrieve the Cloud Properties Using Diverse Remote Sensing Datasets

A Cloud Classification Method Based on a Convolutional Neural Network for FY-4A Satellites

Transferring Deep Models for Cloud Detection in Multisensor Images via Weakly Supervised Learning

Advancing Satellite-Derived Precipitation Downscaling in Data-Sparse Area Through Deep Transfer Learning

Satellite Imagery-Based Cloud Classification Using Deep Learning

A New Satellite-Based Precipitation Downscaling Scheme for Data-sparse Areas Using Deep Learning and Transfer Learning

Dilated multi-scale cascade forest for satellite image classification

Classification of Large-Scale High-Resolution SAR Images with Deep Transfer Learning

Cloud Detection in Remote Sensing Images Based on Multiscale Features-Convolutional Neural Network

Multilevel Cloud Detection in Remote Sensing Images Based on Deep Learning

Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors

Satellite cloud image segmentation based on lightweight convolutional neural network

Spatial–Temporal Approach and Dataset for Enhancing Cloud Detection in Sentinel-2 Imagery: A Case Study in China