U-HRNet+: a real-time precipitation estimation method based on the fusion of temporal and spatial domain features

Runzhe Tao,Yonghong Zhang,Jiangeng Wang,Peibei Zheng,Liyang Liu
DOI: https://doi.org/10.1080/01431161.2024.2359731
IF: 3.531
2024-06-26
International Journal of Remote Sensing
Abstract:The precipitation estimation with high spatial and temporal resolution over Tibet is of great significance for monitoring the stability of the plateau ecosystem and early warning of natural disasters. In response to the problem of the unsatisfactory accuracy in traditional real-time precipitation inversion methods and quantitative accuracy estimation products in this region. This paper adopts deep-learning methods to explore the corresponding relationship between precipitation and multi-band observation data from geostationary satellite imagery. The U-High Resolution Network (U-HRNet) as backbone is fully exploited to generate multi-scale features and fused using attention gates to extract high-resolution spatial representations representing precipitation clouds, thereby achieving precipitation estimation of target clouds at different scales. In addition, in response to the characteristics of high precipitation intensity and drastic cloud cluster changes in summer convective weather within a short period of time, a multi-head attention mechanism is introduced to extract temporal information from time series inputs and fuse it with spatial features to improve the accuracy of real-time precipitation estimation. Compared with the operational precipitation products and baseline deep-learning models, the classification metrics such as Probability of detection (POD), False Alarm Ratio (FAR) and Critical success index (CSI) show that the proposed model (U-HRNet+) has better performance in test set and has high generalization ability for estimating short-term heavy rainfall over Tibet and its surrounding areas in summer. Therefore, the proposed model has the potential to serve as a more accurate and reliable satellite-based precipitation estimation product.
imaging science & photographic technology,remote sensing
What problem does this paper attempt to address?