Abstract:Precipitation plays a significant role in global water and energy cycles, largely affecting many aspects of human life, such as transportation and agriculture. Recently, meteorologists have tried to predict precipitation with deep learning methods by learning from much historical meteorological data. Under this paradigm, the task of precipitation nowcasting is formulated as a spatiotemporal sequence forecasting problem. However, current studies suffer from two inherent drawbacks of the definition of the problem. First, considering that the weather patterns vary in spatial and temporal dimensions, a spatiotemporally shared kernel is not optimal for capturing features across different regions and seasons. Second, these methods isolate the precipitation from other meteorological elements, such as temperature, humidity, and wind. The disability of cross-model learning prevents the possibility of the promotion of precipitation prediction. Therefore, this article proposes a spatiotemporal inference network (STIN) to produce precipitation prediction from multimodal meteorological data with spatiotemporal specific filters. Specifically, we first design a spatiotemporal-aware convolutional layer (STAConv), in which kernels are generated conditioned on the incoming spatiotemporally features vector. Replacing normal convolution with STAConv enables the extraction of spatiotemporal specific information from the meteorological data. Based on the STAConv, the spatiotemporal-aware convolutional neural network (STACNN) is further proposed, fusing the multimodal information, including temperature, humidity, and wind. Then, an encoder–decoder framework composed of RNN layers is built to extract representative temporal dynamics from multimodal information. To investigate the practicality of the proposed method, we employ STIN to predict the following precipitation intensity. Extensive experiments on three meteorological datasets demonstrate the effectiveness of our model on precipitation nowcasting.

Inductive Spatiotemporal Graph Convolutional Networks for Short-Term Quantitative Precipitation Forecasting

A Spatio-Temporal Graph-Guided Convolutional LSTM for Tropical Cyclones Precipitation Nowcasting.

SpatioTemporal Inference Network for Precipitation Nowcasting With Multimodal Fusion

Prior-Guided gated convolutional networks for rainstorm forecasting

Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting

Multi-Information Aggregation and Estrangement HyperGraph Convolutional Networks for Spatiotemporal Weather Forecasting

Conditional Local Convolution for Spatio-Temporal Meteorological Forecasting

Exploring Geometric Deep Learning For Precipitation Nowcasting

Residual Spatiotemporal Convolutional Neural Network Based on Multisource Fusion Data for Approaching Precipitation Forecasting

HiSTGNN: Hierarchical Spatio-temporal Graph Neural Networks for Weather Forecasting

Short-term precipitation prediction using deep learning

A Structured Graph Neural Network for Improving the Numerical Weather Prediction of Rainfall

Multi-STGCnet: A Graph Convolution Based Spatial-Temporal Framework for Subway Passenger Flow Forecasting

Spatio-Temporal Joint Graph Convolutional Networks for Traffic Forecasting

A Graph Convolutional Incorporating GRU Network for Landslide Displacement Forecasting Based on Spatiotemporal Analysis of GNSS Observations

Towards Spatio-temporal Sea Surface Temperature Forecasting via Static and Dynamic Learnable Personalized Graph Convolution Network

Precipitation Forecasting via Multi-Scale Deconstructed ConvLSTM

DGFormer: a physics-guided station level weather forecasting model with dynamic spatial-temporal graph neural network

VN-Net: Vision-Numerical Fusion Graph Convolutional Network for Sparse Spatio-Temporal Meteorological Forecasting

PN-HGNN: Precipitation Nowcasting Network Via Hypergraph Neural Networks

Heterogeneous Dynamic Graph Convolutional Networks for Enhanced Spatiotemporal Flood Forecasting by Remote Sensing