Abstract:Accurate ground-based cloud image categorization is a critical but challenging task that has not been well addressed. One of the essential issues that affect the performance is to extract the representative visual features. Nearly all of the existing methods rely on the hand-crafted descriptors (e. g., local binary patterns, CENsus TRsansform hISTogram, and scale-invariant feature transform). Their limited discriminative power indeed leads to the unsatisfactory performance. To alleviate this, we propose " DeepCloud" as a novel cloud image feature extraction approach by resorting to the deep convolutional visual features. In the recent years, the deep convolutional neural network (CNN) has achieved the promising results in lots of computer vision and image understanding fields. Nevertheless, it has not been applied to cloud image classification yet. Thus, we actually pay the first effort to fill this blank. Since cloud image classification can be attributed to a multi-instance learning problem, simply employing the convolutional features within CNN cannot achieve the promising result. To address this, Fisher vector encoding is applied to executing the spatial feature aggregation and highdimensional feature mapping on the raw deep convolutional features. Moreover, the hierarchical convolutional layers are used simultaneously to capture the fine textural characteristics and high-level semantic information in the unified manner. To further leverage the performance, a cloud pattern mining and selection method are also proposed. It targets at finding the discriminative local patterns to better distinguish the different kinds of clouds. The experiments on a challenging ground-based cloud image data set demonstrate the superiority of the proposition over the stateof- the-art methods.

Illumination-invariant Completed LTP Descriptor for Cloud Classification

Salient Local Binary Pattern for Ground-Based Cloud Classification

Cross-Domain Ground-Based Cloud Classification Based on Transfer of Local Features and Discriminative Metric Learning

Ground-Based Cloud Classification Using Weighted Local Binary Patterns

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

DeepCloud: Ground-Based Cloud Image Categorization Using Deep Convolutional Features.

An Improved Cloud Recognition and Classification Method for Photovoltaic Power Prediction Based on Total-Sky-images

Cloud Classification of Ground-Based Images Using Texture–Structure Features

Mcloud: A Multiview Visual Feature Extraction Mechanism for Ground-Based Cloud Image Categorization

Learning Discriminative Features for Ground-Based Cloud Classification Via Mutual Information Maximization.

Illumination Invariant Face Recognition Based on Improved Local Binary Pattern

Cloud detection in remote sensing image based on linear dimension compression

De-illumination method about recognition of ground-based cloud

Illumination-insensitive Binary Descriptor for Visual Measurement Based on Local Inter-patch Invariance

Ground-Based Cloud Classification Using Pyramid Salient LBP

Svm-Based Cloud Detection Using Combined Texture Features

Cloud Detection Using Super Pixel Classification and Semantic Segmentation

A Novel Illumination-Insensitive Feature Extraction Method

Jumping and Refined Local Pattern for Texture Classification

A Robust Descriptor for Color Texture Classification under Varying Illumination