Abstract:Infrared observation is an all-weather, real-time, large-scale precipitation observation method with high spatio-temporal resolution. A high-precision deep learning algorithm of infrared precipitation estimation can provide powerful data support for precipitation nowcasting and other hydrological studies with high timeliness requirements. The “classification-estimation” two-stage framework is widely used for balancing the data distribution in precipitation estimation algorithms, but still has the error accumulation issue due to its simple series-wound combination mode. In this paper, we propose a multi-task collaboration framework (MTCF), i.e., a novel combination mode of the classification and estimation model, which alleviates the error accumulation and retains the ability to improve the data balance. Specifically, we design a novel positive information feedback loop composed of a consistency constraint mechanism, which largely improves the information abundance and the prediction accuracy of the classification branch, and a cross-branch interaction module (CBIM), which realizes the soft feature transformation between branches via the soft spatial attention mechanism. In addition, we also model and analyze the importance of the input infrared bands, which lay a foundation for further optimizing the input and improving the generalization of the model on other infrared data. Extensive experiments based on Himawari-8 demonstrate that compared with the baseline model, our MTCF obtains a significant improvement by 3.2%, 3.71%, 5.13%, 4.04% in F1-score when the precipitation intensity is 0.5, 2, 5, 10 mm/h, respectively. Moreover, it also has a satisfactory performance in identifying precipitation spatial distribution details and small-scale precipitation, and strong stability to the extreme-precipitation of typhoons.

Convolutional Residual-Attention: A Deep Learning Approach for Precipitation Nowcasting

A Deep Learning‐Based Methodology for Precipitation Nowcasting with Radar

A Spatio-Temporal Graph-Guided Convolutional LSTM for Tropical Cyclones Precipitation Nowcasting.

RainfallNet: A Dual-Source of Spatial-Channel Attention Fusion Network for Precipitation Nowcasting

DSADNet: A Dual-Source Attention Dynamic Neural Network for Precipitation Nowcasting

PredRANN: the Spatiotemporal Attention Convolution Recurrent Neural Network for Precipitation Nowcasting

Residual Spatiotemporal Convolutional Neural Network Based on Multisource Fusion Data for Approaching Precipitation Forecasting

Precipitation Nowcasting Leveraging Spatial Correlation Feature Extraction and Deep Spatio-Temporal Fusion Network

Contextual Sa-Attention Convolutional LSTM for Precipitation Nowcasting: A Spatiotemporal Sequence Forecasting View

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting

A Heterogeneous Spatiotemporal Attention Fusion Prediction Network for Precipitation Nowcasting

Precipitation Forecast Based on Multi-channel ConvLSTM and 3D-CNN

The Reconstitution Predictive Network for Precipitation Nowcasting

Two-stream convolutional LSTM for precipitation nowcasting

Multi-Task Collaboration Deep Learning Framework for Infrared Precipitation Estimation.

A new strong convective precipitation forecasting method based on attention mechanism and spatio-temporal reasoning

Improving Global Precipitation in Numerical Weather Prediction Systems Based on Deep Learning Techniques

Deep Precipitation Nowcasting with Dual Regions Displacement Information and Global Spatiotemporal Representations Learning

Precipitation Nowcasting Using Diffusion Transformer with Causal Attention

trajPredRNN+: A new approach for precipitation nowcasting with weather radar echo images based on deep learning

Enhancing Radar Echo Extrapolation by ConvLSTM2D for Precipitation Nowcasting