Deep Precipitation Nowcasting with Dual Regions Displacement Information and Global Spatiotemporal Representations Learning

Zefeng Pan,Fanfan Ji,Yunlong Zhou,Renlong Hang,Qingshan Liu,Xiao-Tong Yuan

DOI: https://doi.org/10.1109/lgrs.2024.3384772

IF: 5.343

2024-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:The deep precipitation nowcasting using radar echo map prediction can mitigate the socio-economic impact of extreme precipitation events. Existing methods employ long short-term memory (LSTM) to extract rich precipitation features. However, existing methods often combine the learning and modeling of rain and non-rain regions in a single module, without clearly distinguishing their different features and motion patterns, which impairs the spatial distribution and precipitation intensity prediction of rainfall. Moreover, these LSTMs only capture local spatiotemporal features, while ignoring the global spatiotemporal features, resulting in prediction results lacking structural and strength consistency. Therefore, we propose a Dual Regions Center Displacement module (DRCD), which separately learns and models the spatial information of rainfall and non-rainfall regions and employs this module to estimate the locations and intensity residuals of the future regions. Moreover, we also introduce a novel Global LSTM module (GLSTM) that learns the global spatiotemporal features from the sequences, which can estimate the structure and intensity of dual regions. Extensive experiments demonstrate that our method has superior or competitive performance over the state-of-the-art precipitation nowcasting methods, and has the potential to be implemented as an alternative product globally.