Abstract:The state-of-the-art methods for cloud detection are dominated by deep convolutional neural networks (DCNNs). However, it is very expensive to train DCNNs for cloud detection and the trained DCNNs do not always perform well as expected. This paper proposes a shallow CNN (SCNN) by removing pooling/unpooling layers and normalization layers in DCNNs, retaining only three convolutional layers, and equipping them with 3 filters of 1 x 1,1 x 1, 3 x 3 in spatial dimensions. It demonstrates that the three convolutional layers are sufficient for cloud detection. Since the label output by the SCNN for a pixel depends on a 3 x 3 patch around this pixel, the SCNN can be trained using some thousands 3 x 3 patches together with ground truth of their center pixels. It is very cheap to train a SCNN using some thousands 3 x 3 patches and to provide ground truth of their center pixels. Despite of its low cost, SCNN training is stabler than DCNN training, and the trained SCNN outperforms the representative state-of-the-art DCNNs for cloud detection. The same resolution of original image, feature maps and final label map assures that details are not lost as by pooling/unpooling in DCNNs. The border artifacts suffering from deep convolutional and pooling/unpooling layers are minimized by 3 convolutional layers with 1x1, 1x1, 3x3 filters. Incoherent patches suffering from patch -by -patch segmentation and batch normalization are eliminated by SCNN without normalization layers. Extensive experiments based on the L7 Irish, L8 Biome and GF1 WHU datasets are carried out to evaluate the proposed method and compare with state-of-the-art methods. The proposed SCNN promises to deal with images from any other sensors. The code and data will be open for further research. 1

Fast Cloud Image Segmentation with Superpixel Analysis Based Convolutional Networks

Deep Superpixel Convolutional Network for Image Recognition

Cloud Detection Using Super Pixel Classification and Semantic Segmentation

Super-pixel cloud detection using Hierarchical Fusion CNN

SegCloud: a Novel Cloud Image Segmentation Model Using a Deep Convolutional Neural Network for Ground-Based All-Sky-view Camera Observation

Improving Semantic Image Segmentation with a Probabilistic Superpixel-Based Dense Conditional Random Field.

Satellite cloud image segmentation based on lightweight convolutional neural network

Automatic segmentation algorithm for high-spatial-resolution remote sensing images based on self-learning super-pixel convolutional network

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Automatic Cloud Segmentation Based on Fused Fully Convolutional Networks.

Superpixel Segmentation with Attention Convolution Neural Network

Automatic Cloud Detection for All-Sky Images Using Superpixel Segmentation

Remote Sensing Image Cloud Detection Using a Shallow Convolutional Neural Network

The Image Segmentation Based on Optimized Spatial Feature of Superpixel

Superpixel Guided Network for Weakly Supervised Semantic Segmentation

Cloud Segmentation of Remote Sensing Images on Landsat-8 by Deep Learning

Fast medical image segmentation based on patch sharing

CloudU-Net: A Deep Convolutional Neural Network Architecture for Daytime and Nighttime Cloud Images’ Segmentation

CloudU-Netv2: A Cloud Segmentation Method for Ground-Based Cloud Images Based on Deep Learning

Radiation Feature Fusion Dual-Attention Cloud Segmentation Network

An Aerial Image Segmentation Approach Based on Enhanced Multi-Scale Convolutional Neural Network