Abstract:The accurate detection of Mesoscale Convective Systems (MCS) is crucial for meteorological monitoring due to their potential to cause significant destruction through severe weather phenomena such as hail, thunderstorms, and heavy rainfall. However, the existing methods for MCS detection mostly targets on single-frame detection, which just considers the static characteristics and ignores the temporal evolution in the life cycle of MCS. In this paper, we propose a novel encoder-decoder neural network for MCS detection(MCSDNet). MCSDNet has a simple architecture and is easy to expand. Different from the previous models, MCSDNet targets on multi-frames detection and leverages multi-scale spatiotemporal information for the detection of MCS regions in remote sensing imagery(RSI). As far as we know, it is the first work to utilize multi-scale spatiotemporal information to detect MCS regions. Firstly, we design a multi-scale spatiotemporal information module to extract multi-level semantic from different encoder levels, which makes our models can extract more detail spatiotemporal features. Secondly, a Spatiotemporal Mix Unit(STMU) is introduced to MCSDNet to capture both intra-frame features and inter-frame correlations, which is a scalable module and can be replaced by other spatiotemporal module, e.g., CNN, RNN, Transformer and our proposed Dual Spatiotemporal Attention(DSTA). This means that the future works about spatiotemporal modules can be easily integrated to our model. Finally, we present MCSRSI, the first publicly available dataset for multi-frames MCS detection based on visible channel images from the FY-4A satellite. We also conduct several experiments on MCSRSI and find that our proposed MCSDNet achieve the best performance on MCS detection task when comparing to other baseline methods.

OESA-UNet: An Adaptive and Attentional Network for Detecting Diverse Magnetopause under the Limited Field of View

An Adaptive X‐Ray Dynamic Image Estimation Method Based on OMNI Solar Wind Parameters and SXI Simulated Observations

Rapid Surrogate Modeling of Electromagnetic Data in Frequency Domain Using Neural Operator.

Overshoot Structure Near the Earth’s Subsolar Magnetopause Generated by Magnetopause Motions

A High Temporal, Spatial and Energy Resolution Grid-based Energetic Neutral Atom (ENA) Imager: the Physical Design

A 3D Magnetospheric CT Reconstruction Method Based On 3D GAN and Supplementary Limited‐Angle 2D Soft X‐ray Images

A Deep Learning Approach to Generating Photospheric Vector Magnetograms of Solar Active Regions for SOHO/MDI Using SDO/HMI and BBSO Data

Super-Resolution of SOHO/MDI Magnetograms of Solar Active Regions Using SDO/HMI Data and an Attention-Aided Convolutional Neural Network

Vector Magnetic Anomaly Detection via an Attention Mechanism Deep-Learning Model

A Dual-Attention Mechanism Deep Learning Network for Mesoscale Eddy Detection by Mining Spatiotemporal Characteristics

MCAT-UNet: Convolutional and Cross-Shaped Window Attention Enhanced UNet for Efficient High-Resolution Remote Sensing Image Segmentation

Radio frequency interference detection using efficient multiscale convolutional attention UNet

Radio Frequency Interference Detection Using Efficient Multi-Scale Convolutional Attention UNet

Development of Technique to Detect and Classify Small-Scale Magnetic Flux Cancellation and Rapid Blueshifted Excursions

MCSDNet: Mesoscale Convective System Detection Network via Multi-scale Spatiotemporal Information

Detection of Bering Sea Slope Mesoscale Eddies Derived from Satellite Altimetry Data by an Attention Network

Multi-scale image preprocessing and feature tracking for remote CME characterization

An Ionospheric TEC Forecasting Model Based on a CNN-LSTM-Attention Mechanism Neural Network

Tomographic Reconstruction of the Earth's Magnetosheath from Multiple Spacecraft: A Theoretical Study

Unsupervised classification of simulated magnetospheric regions