Abstract:Lightning is a rapidly evolving phenomenon, exhibiting both mesoscale and microscale characteristics. Its prediction significantly relies on timely and accurate data observation. With the implementation of new generation weather radar systems and lightning detection networks, radar reflectivity image products, and lightning observation data are becoming increasingly abundant. Research focus has shifted towards lightning nowcasting (prediction of imminent events), utilizing deep learning (DL) methods to extract lightning features from very large data sets. In this paper, we propose a novel spatio-temporal fusion deep learning lightning nowcasting network (STF-LightNet) for lightning nowcasting. The network is based on a 3-dimensional U-Net architecture with encoder-decoder blocks and adopts a structure of multiple branches as well as the main path for the encoder block. To address the challenges of feature extraction and fusion of multi-source data, multiple branches are used to extract different data features independently, and the main path fuses these features. Additionally, a spatial attention (SA) module is added to each branch and the main path to automatically identify lightning areas and enhance their features. The main path fusion is conducted in two steps: the first step fuses features from the branches, and the second fuses features from the previous and current levels of the main path using two different methodsthe weighted summation fusion method and the attention gate fusion method. To overcome the sparsity of lightning observations, we employ an inverse frequency weighted cross-entropy loss function. Finally, STF-LightNet is trained using observations from the previous half hour to predict lightning in the next hour. The outcomes illustrate that the fusion of both the multi-branch and main path structures enhances the network's ability to effectively integrate features from diverse data sources. Attention mechanisms and fusion modules allow the network to capture more detailed features in the images.

Experimental Study of Cloud-to-Ground Lightning Nowcasting with Multisource Data Based on a Video Prediction Method

Enhanced Rainfall Nowcasting of Tropical Cyclone by an Interpretable Deep Learning Model and Its Application in Real-Time Flood Forecasting

Convective Storm VIL and Lightning Nowcasting Using Satellite and Weather Radar Measurements Based on Multi-Task Learning Models

Real-Time Flood Forecasting Via Parameter Regionalization and Blending Nowcasts with NWP Forecasts over the Jiao River, China

A spatio-temporal fusion deep learning network with application to lightning nowcasting

A STUDY OF LIGHTNING NOWCASTING METHOD USING LD-Ⅱ AND CINRAD-SA RADAR DATA

Nowcasting of the Thunderstorm Trend Based on Data Collected by Lightning Location System

Advances in Study of Lightning Monitoring,Warning and Forecasting Technology

Application of Multi-channel 3D-Cube Successive Convolution Network for Convective Storm Nowcasting

A deep learning framework for lightning forecasting with multi‐source spatiotemporal data

Development of Lightning Nowcasting and Warning Method and System

Forecasting of Local Lightning Using Spatial–Channel-Enhanced Recurrent Convolutional Neural Network

A Three-dimensional Convolutional-Recurrent Network for Convective Storm Nowcasting

Strong Convective Storm Nowcasting Using a Hybrid Approach of Convolutional Neural Network and Hidden Markov Model

Improving forecasting of strong convection by assimilating cloud-to-ground lightning data using the physical initialization method

Lightning Nowcasting with Aerosol-Informed Machine Learning and Satellite-Enriched Dataset

Nowcasting thunderstorm hazards using machine learning: the impact of data sources on performance

ConvLSTM Network-Based Rainfall Nowcasting Method with Combined Reflectance and Radar-Retrieved Wind Field as Inputs

Nowcasting Heavy Rainfall With Convolutional Long Short-Term Memory Networks: A Pixelwise Modeling Approach

The Application Research of FCN Algorithm in Different Severe Convection Short-Time Nowcasting Technology in China, Gansu Province

Skilful nowcasting of extreme precipitation with NowcastNet