Abstract:Precipitation plays a significant role in global water and energy cycles, largely affecting many aspects of human life, such as transportation and agriculture. Recently, meteorologists have tried to predict precipitation with deep learning methods by learning from much historical meteorological data. Under this paradigm, the task of precipitation nowcasting is formulated as a spatiotemporal sequence forecasting problem. However, current studies suffer from two inherent drawbacks of the definition of the problem. First, considering that the weather patterns vary in spatial and temporal dimensions, a spatiotemporally shared kernel is not optimal for capturing features across different regions and seasons. Second, these methods isolate the precipitation from other meteorological elements, such as temperature, humidity, and wind. The disability of cross-model learning prevents the possibility of the promotion of precipitation prediction. Therefore, this article proposes a spatiotemporal inference network (STIN) to produce precipitation prediction from multimodal meteorological data with spatiotemporal specific filters. Specifically, we first design a spatiotemporal-aware convolutional layer (STAConv), in which kernels are generated conditioned on the incoming spatiotemporally features vector. Replacing normal convolution with STAConv enables the extraction of spatiotemporal specific information from the meteorological data. Based on the STAConv, the spatiotemporal-aware convolutional neural network (STACNN) is further proposed, fusing the multimodal information, including temperature, humidity, and wind. Then, an encoder–decoder framework composed of RNN layers is built to extract representative temporal dynamics from multimodal information. To investigate the practicality of the proposed method, we employ STIN to predict the following precipitation intensity. Extensive experiments on three meteorological datasets demonstrate the effectiveness of our model on precipitation nowcasting.

STAA: Spatio-Temporal Alignment Attention for Short-Term Precipitation Forecasting

STAS: Adaptive Selecting Spatio-Temporal Deep Features for Improving Bias Correction on Precipitation

Medium-long-term prediction of water level based on an improved spatio-temporal attention mechanism for long short-term memory networks

A spatiotemporal deep learning model ST-LSTM-SA for hourly rainfall forecasting using radar echo images

SSAS: Spatiotemporal Scale Adaptive Selection for Improving Bias Correction on Precipitation

Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning

A Spatiotemporal Attention Model for Severe Precipitation Estimation

Quantitative Short-Term Precipitation Model Using Multimodal Data Fusion Based on a Cross-Attention Mechanism

SASTA-Net: Self-Attention Spatiotemporal Adversarial Network for Typhoon Prediction

Deep Learning Integration of Multi-Model Forecast Precipitation Considering Long Lead Times

SpatioTemporal Inference Network for Precipitation Nowcasting With Multimodal Fusion

Interpretable spatio-temporal attention LSTM model for flood forecasting

Short-Term and Imminent Rainfall Prediction Model Based on ConvLSTM and SmaAT-UNet

PrecipLSTM: A Meteorological Spatiotemporal LSTM for Precipitation Nowcasting

Spatio-Temporal Attention LSTM Model for Flood Forecasting

STFM: Accurate Spatio-Temporal Fusion Model for Weather Forecasting

A new strong convective precipitation forecasting method based on attention mechanism and spatio-temporal reasoning

Spatiotemporal Enhanced Adversarial Network for Precipitation Nowcasting

Residual Spatiotemporal Convolutional Neural Network Based on Multisource Fusion Data for Approaching Precipitation Forecasting

Prediction of Large-Scale Regional Evapotranspiration Based on Multi-Scale Feature Extraction and Multi-Headed Self-Attention

SFANet: Spatial-Frequency Attention Network for Weather Forecasting