Abstract:Cloud recognition is a basic task in ground meteorological observation. It is of great significance to accurately identify cloud types from long-time-series satellite cloud images for improving the reliability and accuracy of weather forecasting. However, different from ground-based cloud images with a small observation range and easy operation, satellite cloud images have a wider cloud coverage area and contain more surface features. Hence, it is difficult to effectively extract the structural shape, area size, contour shape, hue, shadow and texture of clouds through traditional deep learning methods. In order to analyze the regional cloud type characteristics effectively, we construct a China region meteorological satellite cloud image dataset named CRMSCD, which consists of nine cloud types and the clear sky (cloudless). In this paper, we propose a novel neural network model, UATNet, which can realize the pixel-level classification of meteorological satellite cloud images. Our model efficiently integrates the spatial and multi-channel information of clouds. Specifically, several transformer blocks with modified self-attention computation (swin transformer blocks) and patch merging operations are used to build a hierarchical transformer, and spatial displacement is introduced to construct long-distance cross-window connections. In addition, we introduce a Channel Cross fusion with Transformer (CCT) to guide the multi-scale channel fusion, and design an Attention-based Squeeze and Excitation (ASE) to effectively connect the fused multi-scale channel information to the decoder features. The experimental results demonstrate that the proposed model achieved 82.33% PA, 67.79% MPA, 54.51% MIoU and 70.96% FWIoU on CRMSCD. Compared with the existing models, our method produces more precise segmentation performance, which demonstrates its superiority on meteorological satellite cloud recognition tasks.

U-Net for Satellite Image Segmentation: Improving the Weather Forecasting

Real-time Water Area Segmentation for USV using Enhanced U-Net

UATNet: U-Shape Attention-Based Transformer Net for Meteorological Satellite Cloud Recognition

Automatic Cloud Segmentation Based on Fused Fully Convolutional Networks.

Cloud detection of high-resolution remote sensing image based on improved U-Net

Severe Convective Weather Classification In Remote Sensing Images By Semantic Segmentation

CloudU-Net: A Deep Convolutional Neural Network Architecture for Daytime and Nighttime Cloud Images’ Segmentation

A Variational U-Net for Weather Forecasting

U-High resolution network (U-HRNet): cloud detection with high-resolution representations for geostationary satellite imagery

CloudFU-Net: A Fine-Grained Segmentation Method for Ground-Based Cloud Images Based on an Improved Encoder–Decoder Structure

Typhoon cloud image prediction based on enhanced multi-scale deep neural network

CRSNet: Cloud and Cloud Shadow Refinement Segmentation Networks for Remote Sensing Imagery

Forest and Water Bodies Segmentation Through Satellite Images Using U-Net

Segmentation and Visualization of Flooded Areas Through Sentinel-1 Images and U-Net

Solution for CVPR 2024 UG2+ Challenge Track on All Weather Semantic Segmentation

Recognition Algorithm for Deep Convective Clouds Based on FY4A

Tropical and Extratropical Cyclone Detection Using Deep Learning

Deep coastal sea elements forecasting using U-Net based models

Research on Improved U-net Based Remote Sensing Image Segmentation Algorithm

Cloud Detection for Satellite Imagery Using Deep Learning

Deep learning-based aerial image segmentation with open data for disaster impact assessment