Abstract:Numerical Weather Prediction (NWP) models are extensively utilized worldwide and have played a pivotal role in weather forecasting. Precipitation is subject to various intricate factors, rendering it one of the most challenging factors to predict. Additional post-processing steps are required to reduce biases and achieve reliable predictions for precipitation-related decision-making. In this work, we propose a transformer-enhanced spatiotemporal neural network called TransLSTMUNet for short- and medium-range precipitation post-processing. Firstly, TransLSTMUNet employs convolutional operators to extract localized meteorological features. Secondly, it capitalizes on transformer architecture to enrich these extracted features with a broader, global perspective of spatial information. Thirdly, TransLSTMUNet leverages ConvLSTM to further enhance the features with temporal information. Furthermore, to address challenges posed by imbalanced distribution of precipitation intensity, we design a novel loss function called quantile weighted mean squared error (QWMSE). QWMSE simultaneously considers both normal and intense precipitation during the model' s training phase. In the experiments, the THORPEX Interactive Grand Global Ensemble (TIGGE) dataset provided by the European Centre for Medium-Range Weather Forecasts (ECMWF) is used as input for post-processing the precipitation forecasts. The experiments show that the precipitation forecasts post-processed by TransLSTMUNet exhibit the best overall performance compare with the eight post-processing baselines. It significantly improves the forecast performance of TIGGE forecasts. Specifically, TransLSTMUNet enhances the accuracy (ACC) metric by 12.14 % and increases the threat scores (TS) for 24-hour accumulated precipitation of 0.1 mm, 10.0 mm, 25.0 mm, and 50.0 mm by 8.30 %, 9.77 %, 31.60 %, and 51.25 % respectively. By effectively integrating the strengths of convolutional and transformer methodologies, the proposed TransLSTMUNet model offers a novel approach for post-processing precipitation forecasting. This model design has the potential to inspire various other research avenues within the hydrological domain and beyond.

Transformer-enhanced spatiotemporal neural network for post-processing of precipitation forecasts

Post-processing of numerical precipitation forecast based on spatial-temporal deep learning model

ST-TransNet: A Spatiotemporal Transformer Network for Uncertainty Estimation from a Single Deterministic Precipitation Forecast

Successful Precipitation Downscaling Through an Innovative Transformer-Based Model

Spatio-Temporal Transformer Network for Weather Forecasting

Spatiotemporal model based on transformer for bias correction and temporal downscaling of forecasts

A Spatio-Temporal Graph-Guided Convolutional LSTM for Tropical Cyclones Precipitation Nowcasting.

An Evaluation of Post-Processed TIGGE Multimodel Ensemble Precipitation Forecast in the Huai River Basin

MMSTP: Multi-modal Spatiotemporal Feature Fusion Network for Precipitation Prediction

LPT-QPN: A Lightweight Physics-Informed Transformer for Quantitative Precipitation Nowcasting

Multi-Task Spatial-Temporal Transformer for Multi-Variable Meteorological Forecasting

Improving Boreal Summer Precipitation Predictions From the Global NMME Through Res34‐Unet

Spatiotemporal Feature Fusion Transformer for Precipitation Nowcasting Via Feature Crossing

MDTNet: Multi-scale Deformable Transformer Network with Fourier Space Losses Toward Fine-scale Spatiotemporal Precipitation Nowcasting

Improving Global Precipitation in Numerical Weather Prediction Systems Based on Deep Learning Techniques

Improving the Short-Range Precipitation Forecast of Numerical Weather Prediction Through a Deep Learning-Based Mask Approach

Precipitation Forecasting via Multi-Scale Deconstructed ConvLSTM

UTrans-Net: A Model for Short-Term Precipitation Prediction

Enhancing Quantitative Precipitation Estimation of NWP Model With Fundamental Meteorological Variables and Transformer Based Deep Learning Model

Multi-Layer Networks for Ensemble Precipitation Forecasts Postprocessing.

AA-TransUNet: Attention Augmented TransUNet For Nowcasting Tasks