Abstract:Automatic cloud detection in remote sensing images is of great significance. Deep-learning-based methods can achieve cloud detection with high accuracy; however, network training heavily relies on a large number of labels. Manually labelling pixel-wise level cloud and non-cloud annotations for many remote sensing images is laborious and requires expert-level knowledge. Different types of satellite images cannot share a set of training data, due to the difference in spectral range and spatial resolution between them. Hence, labelled samples in each upcoming satellite image are required to train a new deep-learning-based model. In order to overcome such a limitation, a novel cloud detection algorithm based on a spectral library and convolutional neural network (CD-SLCNN) was proposed in this paper. In this method, the residual learning and one-dimensional CNN (Res-1D-CNN) was used to accurately capture the spectral information of the pixels based on the prior spectral library, effectively preventing errors due to the uncertainties in thin clouds, broken clouds, and clear-sky pixels during remote sensing interpretation. Benefiting from data simulation, the method is suitable for the cloud detection of different types of multispectral data. A total of 62 Landsat-8 Operational Land Imagers (OLI), 25 Moderate Resolution Imaging Spectroradiometers (MODIS), and 20 Sentinel-2 satellite images acquired at different times and over different types of underlying surfaces, such as a high vegetation coverage, urban area, bare soil, water, and mountains, were used for cloud detection validation and quantitative analysis, and the cloud detection results were compared with the results from the function of the mask, MODIS cloud mask, support vector machine, and random forest. The comparison revealed that the CD-SLCNN method achieved the best performance, with a higher overall accuracy (95.6%, 95.36%, 94.27%) and mean intersection over union (77.82%, 77.94%, 77.23%) on the Landsat-8 OLI, MODIS, and Sentinel-2 data, respectively. The CD-SLCNN algorithm produced consistent results with a more accurate cloud contour on thick, thin, and broken clouds over a diverse underlying surface, and had a stable performance regarding bright surfaces, such as buildings, ice, and snow.

Cloud Detection Algorithm for Remote Sensing Images Using Fully Convolutional Neural Networks

Research on Cloud Detection Method of Multi-Spectral Remote Sensing Image in Ice and Snow Area

Cloud Detection in Remote Sensing Images Based on Multiscale Features-Convolutional Neural Network

Cloud Detection Algorithm for Multi-Satellite Remote Sensing Imagery Based on a Spectral Library and 1D Convolutional Neural Network

Cloud and Cloud Shadow Segmentation for Remote Sensing Imagery Via Filtered Jaccard Loss Function and Parametric Augmentation

Multiresolution Fully Convolutional Networks to detect Clouds and Snow through Optical Satellite Images

Remote Sensing Image Cloud Detection Using a Shallow Convolutional Neural Network

Multilevel Cloud Detection in Remote Sensing Images Based on Deep Learning

Convolutional Neural Network-Driven Improvements in Global Cloud Detection for Landsat 8 and Transfer Learning on Sentinel-2 Imagery

Cloud and cloud shadow detection in Landsat imagery based on deep convolutional neural networks

An Automatic Cloud Detection Neural Network for High-Resolution Remote Sensing Imagery With Cloud–Snow Coexistence

Multi-scale convolutional neural networks for cloud segmentation

SFRS-Net: A Cloud-Detection Method Based on Deep Convolutional Neural Networks for GF-1 Remote-Sensing Images

Multi-scale Cloud Detection in Remote Sensing Images using a Dual Convolutional Neural Network

Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors

Cloud Detection From High-Resolution Remote Sensing Images Based on Convolutional Neural Networks With Geographic Features and Contextual Information

A Cloud Detection Method Using Convolutional Neural Network Based on Gabor Transform and Attention Mechanism with Dark Channel Subnet for Remote Sensing Image

Distinguishing Cloud and Snow in Satellite Images Via Deep Convolutional Network

Cloud Detection Method Based on Spatial–Spectral Features and Encoder–Decoder Feature Fusion