Abstract:Cloud detection is a significant preprocessing step for increasing the exploitability of remote sensing imagery that faces various levels of difficulty due to the complexity of underlying surfaces, insufficient training data, and redundant information in high-dimensional data. To solve these problems, we propose an unsupervised network for cloud detection (UNCD) on multispectral (MS) and hyperspectral (HS) remote sensing images. The UNCD method enforces discriminative feature learning to obtain the residual error between the original input and the background in deep latent space, which is based on the observation that clouds are sparse and modeled as sparse outliers in remote sensing imagery. The UNCD enforces discriminative feature learning to obtain the residual error between the original input and the background in deep latent space, which is based on the observation that clouds are sparse and modeled as sparse outliers in remote sensing imagery. First, a compact representation of the original imagery is obtained by a latent adversarial learning constrained encoder. Meanwhile, the majority class with sufficient samples (i.e., background pixels) is more accurately reconstructed than the clouds with limited samples by the decoder. An image discriminator is used to prevent the generalization of out-of-class features caused by latent adversarial learning. To further highlight the background information in the deep latent space, a multivariate Gaussian distribution is introduced. In particular, the residual error with clouds highlighted and background samples suppressed is applied in the cloud detection in deep latent space. To evaluate the performance of the proposed UNCD method, experiments were conducted on both MS and HS datasets that were captured by various sensors over various scenes, and the results demonstrate its state-of-the-art performance. The sensors that captured the datasets include Landsat 8, GaoFen-1 (GF-1), and GaoFen-5 (GF-5). Landsat 8 was launched at Vandenberg Air Force Base in California on 11 February 2013, in a mission that was initially known as the Landsat Data Continuity Mission (LDCM). China launched the GF-1 satellite. The GF-5 satellite captures hyperspectral observations in the Chinese Key Projects of High-Resolution Earth Observation System. The overall accuracy (OA) values for Images I and II from the Landsat 8 dataset were 0.9526 and 0.9536, respectively, and the OA values for Images III and IV from the GF-1 wide field of view (WFV) dataset were 0.9957 and 0.9934, respectively. Hence, the proposed method outperformed the other considered methods.

Capturing the Diversity of Mesoscale Trade Wind Cumuli Using Complementary Approaches From Self‐Supervised Deep Learning

Combining crowd-sourcing and deep learning to explore the meso-scale organization of shallow convection

Simultaneous Retrieval Algorithm of Water Cloud Optical and Microphysical Properties by High-Spectral-Resolution Lidar

Machine-learned cloud classes from satellite data for process-oriented climate model evaluation

Charting the Realms of Mesoscale Cloud Organisation using Unsupervised Learning

Generating the Cloud Motion Winds Field from Satellite Cloud Imagery Using Deep Learning Approach

Cumulo: A Dataset for Learning Cloud Classes

Multi-View Ground-Based Cloud Recognition by Transferring Deep Visual Information

A Global Classification Dataset of Daytime and Nighttime Marine Low-cloud Mesoscale Morphology Based on Deep Learning Methods

An Efficient Method for Microphysical Property Retrievals in Vertically Inhomogeneous Marine Water Clouds Using MODIS-CloudSat Measurements

Deep Learning for Sea Surface Temperature Reconstruction under Cloud Occlusion

Improving Prediction of Marine Low Clouds with Cloud Droplet Number Concentration and a Deep Learning Method

Machine learning of cloud types in satellite observations and climate models

Multi-scale decomposition of sea surface height snapshots using machine learning

Detection of clouds in multiple wind velocity fields using ground-based infrared sky images

Implicit Neural Representations for Simultaneous Reduction and Continuous Reconstruction of Multi-Altitude Climate Data

Imbalanced Multi-layer Cloud Classification with Advanced Baseline Imager (ABI) and CloudSat/CALIPSO Data

Deriving Accurate Surface Meteorological States at Arbitrary Locations Via Observation-Guided Continuous Neural Field Modeling.

Temperature Structure Inversion of Mesoscale Eddies in the South China Sea Based on Deep Learning

Discriminative Feature Learning Constrained Unsupervised Network for Cloud Detection in Remote Sensing Imagery.

Learning Sentinel-2 reflectance dynamics for data-driven assimilation and forecasting