Abstract:Lightning is a rapidly evolving phenomenon, exhibiting both mesoscale and microscale characteristics. Its prediction significantly relies on timely and accurate data observation. With the implementation of new generation weather radar systems and lightning detection networks, radar reflectivity image products, and lightning observation data are becoming increasingly abundant. Research focus has shifted towards lightning nowcasting (prediction of imminent events), utilizing deep learning (DL) methods to extract lightning features from very large data sets. In this paper, we propose a novel spatio-temporal fusion deep learning lightning nowcasting network (STF-LightNet) for lightning nowcasting. The network is based on a 3-dimensional U-Net architecture with encoder-decoder blocks and adopts a structure of multiple branches as well as the main path for the encoder block. To address the challenges of feature extraction and fusion of multi-source data, multiple branches are used to extract different data features independently, and the main path fuses these features. Additionally, a spatial attention (SA) module is added to each branch and the main path to automatically identify lightning areas and enhance their features. The main path fusion is conducted in two steps: the first step fuses features from the branches, and the second fuses features from the previous and current levels of the main path using two different methodsthe weighted summation fusion method and the attention gate fusion method. To overcome the sparsity of lightning observations, we employ an inverse frequency weighted cross-entropy loss function. Finally, STF-LightNet is trained using observations from the previous half hour to predict lightning in the next hour. The outcomes illustrate that the fusion of both the multi-branch and main path structures enhances the network's ability to effectively integrate features from diverse data sources. Attention mechanisms and fusion modules allow the network to capture more detailed features in the images.

A deep learning framework for lightning forecasting with multi‐source spatiotemporal data

LightNet+: A Dual-Source Lightning Forecasting Network with Bi-Direction Spatiotemporal Transformation

A spatio-temporal fusion deep learning network with application to lightning nowcasting

Attention-Based Dual-Source Spatiotemporal Neural Network for Lightning Forecast

Deep Learning for Day Forecasts from Sparse Observations

Monitoring Lightning Location Based on Deep Learning Combined with Multisource Spatial Data

A Spatiotemporal Deep Neural Network for Fine-Grained Multi-Horizon Wind Prediction

Convective Storm VIL and Lightning Nowcasting Using Satellite and Weather Radar Measurements Based on Multi-Task Learning Models

Experimental Study of Cloud-to-Ground Lightning Nowcasting with Multisource Data Based on a Video Prediction Method

Short-term precipitation prediction using deep learning

Hierarchical U-net with re-parameterization technique for spatio-temporal weather forecasting

DeepPhysiNet: Bridging Deep Learning and Atmospheric Physics for Accurate and Continuous Weather Modeling

Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5

Deep Learning Integration of Multi-Model Forecast Precipitation Considering Long Lead Times

FlashBench: A lightning nowcasting framework based on the hybrid deep learning and physics-based dynamical models

Multi-Model Fusion Short-Term Load Forecasting Based on Random Forest Feature Selection and Hybrid Neural Network

Intra-Hour Photovoltaic Generation Forecasting Based on Multi-Source Data and Deep Learning Methods

SFANet: Spatial-Frequency Attention Network for Weather Forecasting

A Refined Wind Power Forecasting Method with High Temporal Resolution Based on Light Convolutional Neural Network Architecture

A comparative study of the data-driven day-ahead hourly provincial load forecasting methods: From classical data mining to deep learning

A Deep Learning Framework for Short-term Power Load Forecasting