Spacetime Separable Latent Diffusion Model With Intensity Structure Information for Precipitation Nowcasting
XuDong Ling,ChaoRong Li,LiHong Zhu,FengQing Qin,Ping Zhu,Yuanyuan Huang
DOI: https://doi.org/10.1109/tgrs.2024.3444789
IF: 8.2
2024-09-02
IEEE Transactions on Geoscience and Remote Sensing
Abstract:The growing volume of meteorological data and advancements in computing performance have made the application of deep learning technology in short-term rainfall prediction crucial. However, existing learning approaches struggle to accurately predict detailed spatial location information, particularly obvious in predicting extreme rainfall events, leading to inadequate prediction accuracy and subpar performance in meteorological assessment indicators, limiting the effectiveness and applicability of deep learning models in rainfall prediction. To address these challenges, we propose a spacetime separable latent diffusion model with intensity structure information (SSLDM-ISI) to capture spatial and temporal information more efficiently. SSLDM-ISI incorporates two key strategies to solve the spatiotemporal information issue. First, a spatiotemporal conversion block (STC Block) within the backbone network effectively extracts and integrates spatiotemporal information. Second, our proposed latent space coding technique based on rainfall intensity structural information enhances the information representation ability of extreme rainfall. In addition, an examination of the impact of various conditions is conducted on the prediction results to enhance the model's prediction accuracy and stability. Through comparative analysis of meteorological evaluation and image quality evaluation indicators on two datasets, our proposed approach outperforms existing advanced technologies in short-term rainfall prediction, achieving current state-of-the-art results. Our project is open source and available on GitHub at: https://github.com/ybu-lxd/SISLDM-ISI
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics