Abstract:Cloud detection is a significant preprocessing step for increasing the exploitability of remote sensing imagery that faces various levels of difficulty due to the complexity of underlying surfaces, insufficient training data, and redundant information in high-dimensional data. To solve these problems, we propose an unsupervised network for cloud detection (UNCD) on multispectral (MS) and hyperspectral (HS) remote sensing images. The UNCD method enforces discriminative feature learning to obtain the residual error between the original input and the background in deep latent space, which is based on the observation that clouds are sparse and modeled as sparse outliers in remote sensing imagery. The UNCD enforces discriminative feature learning to obtain the residual error between the original input and the background in deep latent space, which is based on the observation that clouds are sparse and modeled as sparse outliers in remote sensing imagery. First, a compact representation of the original imagery is obtained by a latent adversarial learning constrained encoder. Meanwhile, the majority class with sufficient samples (i.e., background pixels) is more accurately reconstructed than the clouds with limited samples by the decoder. An image discriminator is used to prevent the generalization of out-of-class features caused by latent adversarial learning. To further highlight the background information in the deep latent space, a multivariate Gaussian distribution is introduced. In particular, the residual error with clouds highlighted and background samples suppressed is applied in the cloud detection in deep latent space. To evaluate the performance of the proposed UNCD method, experiments were conducted on both MS and HS datasets that were captured by various sensors over various scenes, and the results demonstrate its state-of-the-art performance. The sensors that captured the datasets include Landsat 8, GaoFen-1 (GF-1), and GaoFen-5 (GF-5). Landsat 8 was launched at Vandenberg Air Force Base in California on 11 February 2013, in a mission that was initially known as the Landsat Data Continuity Mission (LDCM). China launched the GF-1 satellite. The GF-5 satellite captures hyperspectral observations in the Chinese Key Projects of High-Resolution Earth Observation System. The overall accuracy (OA) values for Images I and II from the Landsat 8 dataset were 0.9526 and 0.9536, respectively, and the OA values for Images III and IV from the GF-1 wide field of view (WFV) dataset were 0.9957 and 0.9934, respectively. Hence, the proposed method outperformed the other considered methods.

Feature Discrimination in Large Scale Satellite Image Browsing and Retrieval

Improvement of Underwater Color Discriminative Ability by Multispectral Imaging

Geometric Discriminative Features for Aerial Image Retrieval in Social Media

Massive-Scale Visual Information Retrieval towards City Residential Environment Surveillance

Geometry-Preserving Perceptual Feature Selection for Categorizing LR Aerial Photographs

Discriminating Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Review

Cross-Scene Feature Selection For Hyperspectral Images Based On Cross-Domain Information Gain

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

A Semisupervised Infinite Latent Dirichlet Allocation Model for Target Discrimination in SAR Images with Complex Scenes

Visual Attention-Based Target Detection and Discrimination for High-Resolution SAR Images in Complex Scenes

Categorizing Low-Resolution Aerial Photos by Hessian-Regularized Perceptual Feature Selection

Simultaneous Spectral-Spatial Feature Selection and Extraction for Hyperspectral Images

Feature Learning Using Spatial-Spectral Hypergraph Discriminant Analysis for Hyperspectral Image.

Discriminative Feature Learning Constrained Unsupervised Network for Cloud Detection in Remote Sensing Imagery.

Edge-Guided Image Object Detection in Multiscale Segmentation for High-Resolution Remotely Sensed Imagery.

Object detection in remote sensing imagery using a discriminatively trained mixture model

Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding

Incorporating spectral, texture and shape information for high spatial resolution satellite imagery classification

An automatically recursive feature elimination method based on threshold decision in random forest classification

A New Method for Spatial Feature Extraction and Classification of Remote Sensing Image

A Cyclic Information–Interaction Model for Remote Sensing Image Segmentation