Abstract:Cloud detection is a significant preprocessing step for increasing the exploitability of remote sensing imagery that faces various levels of difficulty due to the complexity of underlying surfaces, insufficient training data, and redundant information in high-dimensional data. To solve these problems, we propose an unsupervised network for cloud detection (UNCD) on multispectral (MS) and hyperspectral (HS) remote sensing images. The UNCD method enforces discriminative feature learning to obtain the residual error between the original input and the background in deep latent space, which is based on the observation that clouds are sparse and modeled as sparse outliers in remote sensing imagery. The UNCD enforces discriminative feature learning to obtain the residual error between the original input and the background in deep latent space, which is based on the observation that clouds are sparse and modeled as sparse outliers in remote sensing imagery. First, a compact representation of the original imagery is obtained by a latent adversarial learning constrained encoder. Meanwhile, the majority class with sufficient samples (i.e., background pixels) is more accurately reconstructed than the clouds with limited samples by the decoder. An image discriminator is used to prevent the generalization of out-of-class features caused by latent adversarial learning. To further highlight the background information in the deep latent space, a multivariate Gaussian distribution is introduced. In particular, the residual error with clouds highlighted and background samples suppressed is applied in the cloud detection in deep latent space. To evaluate the performance of the proposed UNCD method, experiments were conducted on both MS and HS datasets that were captured by various sensors over various scenes, and the results demonstrate its state-of-the-art performance. The sensors that captured the datasets include Landsat 8, GaoFen-1 (GF-1), and GaoFen-5 (GF-5). Landsat 8 was launched at Vandenberg Air Force Base in California on 11 February 2013, in a mission that was initially known as the Landsat Data Continuity Mission (LDCM). China launched the GF-1 satellite. The GF-5 satellite captures hyperspectral observations in the Chinese Key Projects of High-Resolution Earth Observation System. The overall accuracy (OA) values for Images I and II from the Landsat 8 dataset were 0.9526 and 0.9536, respectively, and the OA values for Images III and IV from the GF-1 wide field of view (WFV) dataset were 0.9957 and 0.9934, respectively. Hence, the proposed method outperformed the other considered methods.

Cloud detection of multi-type satellite images based on spectral assimilation and deep learning

Cloud Detection Algorithm for Multi-Satellite Remote Sensing Imagery Based on a Spectral Library and 1D Convolutional Neural Network

Convolutional Neural Network-Driven Improvements in Global Cloud Detection for Landsat 8 and Transfer Learning on Sentinel-2 Imagery

Discriminative Feature Learning Constrained Unsupervised Network for Cloud Detection in Remote Sensing Imagery.

Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors

A Lightweight Deep Learning-Based Cloud Detection Method for Sentinel-2A Imagery Fusing Multiscale Spectral and Spatial Features

Cloud Detection for Satellite Imagery Using Deep Learning

Benchmarking Deep Learning Models for Cloud Detection in Landsat-8 and Sentinel-2 Images

Utilizing Multilevel Features For Cloud Detection On Satellite Imagery

Optical Remote Sensing Image Cloud Detection with Self-Attention and Spatial Pyramid Pooling Fusion

Cloud detection sample generation algorithm for nighttime satellite imagery based on daytime data and machine learning application

Spatial–Temporal Approach and Dataset for Enhancing Cloud Detection in Sentinel-2 Imagery: A Case Study in China

Cloud Detection Of Remote Sensing Images By Deep Learning

Improved cloud detection for Landsat 8 images using a combined neural network model

Supervised Cloud Presence Detection in Remote Sensing Image

Deep Learning-Based Cloud Detection for Optical Remote Sensing Images: A Survey

Cloud and cloud shadow detection in Landsat imagery based on deep convolutional neural networks

Semi-Supervised Cloud Detection for Remote Sensing Imagery Via Self-Training

Cloud detection in Landsat-8 imagery in Google Earth Engine based on a deep neural network

Cloud Detection Method Based on Improved DeeplabV3+ Remote Sensing Image

DeepMask: an algorithm for cloud and cloud shadow detection in optical satellite remote sensing images using deep residual network