Abstract:Lightning is a rapidly evolving phenomenon, exhibiting both mesoscale and microscale characteristics. Its prediction significantly relies on timely and accurate data observation. With the implementation of new generation weather radar systems and lightning detection networks, radar reflectivity image products, and lightning observation data are becoming increasingly abundant. Research focus has shifted towards lightning nowcasting (prediction of imminent events), utilizing deep learning (DL) methods to extract lightning features from very large data sets. In this paper, we propose a novel spatio-temporal fusion deep learning lightning nowcasting network (STF-LightNet) for lightning nowcasting. The network is based on a 3-dimensional U-Net architecture with encoder-decoder blocks and adopts a structure of multiple branches as well as the main path for the encoder block. To address the challenges of feature extraction and fusion of multi-source data, multiple branches are used to extract different data features independently, and the main path fuses these features. Additionally, a spatial attention (SA) module is added to each branch and the main path to automatically identify lightning areas and enhance their features. The main path fusion is conducted in two steps: the first step fuses features from the branches, and the second fuses features from the previous and current levels of the main path using two different methodsthe weighted summation fusion method and the attention gate fusion method. To overcome the sparsity of lightning observations, we employ an inverse frequency weighted cross-entropy loss function. Finally, STF-LightNet is trained using observations from the previous half hour to predict lightning in the next hour. The outcomes illustrate that the fusion of both the multi-branch and main path structures enhances the network's ability to effectively integrate features from diverse data sources. Attention mechanisms and fusion modules allow the network to capture more detailed features in the images.

A Spatio-Temporal Neural Network for Fine-Scale Wind Field Nowcasting Based on Lidar Observation

A Spatiotemporal Deep Neural Network for Fine-Grained Multi-Horizon Wind Prediction

Urban wind field prediction based on sparse sensors and physics‐informed graph‐assisted auto‐encoder

A Refined Wind Power Forecasting Method with High Temporal Resolution Based on Light Convolutional Neural Network Architecture

A novel temporal–spatial graph neural network for wind power forecasting considering blockage effects

Strong Spatiotemporal Radar Echo Nowcasting Combining 3DCNN and Bi-Directional Convolutional LSTM

Short-term Prediction of Offshore Wind Power Based on CNN and LSTM

Toward a Deep-Learning-Network-Based Convective Weather Initiation Algorithm From the Joint Observations of Fengyun-4A Geostationary Satellite and Radar for 0–1h Nowcasting

Enhanced Wind-Field Detection Using an Adaptive Noise-Reduction Peak-Retrieval (ANRPR) Algorithm for Coherent Doppler Lidar

ConvLSTM Network-Based Rainfall Nowcasting Method with Combined Reflectance and Radar-Retrieved Wind Field as Inputs

Denoising coherent Doppler lidar data based on a U-Net convolutional neural network

A spatio-temporal fusion deep learning network with application to lightning nowcasting

High‐Precision and Fast Prediction of Regional Wind Fields in Near Space Using Neural‐Network Approximation of Operators

Weather image-based short-term dense wind speed forecast with a ConvLSTM-LSTM deep learning model

2-D Regional Short-Term Wind Speed Forecast Based on CNN-LSTM Deep Learning Model

Spatiotemporal wind speed forecasting using conditional local convolution and multidimensional meteorology features

Wind Profile Reconstruction Based on Convolutional Neural Network for Incoherent Doppler Wind LiDAR

A deep learning framework for lightning forecasting with multi‐source spatiotemporal data

Precipitation Nowcasting Leveraging Spatial Correlation Feature Extraction and Deep Spatio-Temporal Fusion Network

Physics-inspired and data-driven two-stage deep learning approach for wind field reconstruction with experimental validation

Spatial correlation learning based on graph neural network for medium-term wind power forecasting