Comparison of Traditional Method and Triple Collocation Analysis for Evaluation of Multiple Gridded Precipitation Products across Germany

Zheng Duan,Edward Duggan,Cheng Chen,Hongkai Gao,Jianzhi Dong,Junzhi Liu
DOI: https://doi.org/10.1175/JHM-D-21-0049.1
2021-01-01
Journal of Hydrometeorology
Abstract:Evaluating the accuracy of precipitation products is essential for many applications. The traditional method for evaluation is to calculate error metrics of products with gauge measurements that are considered as ground truth. The multiplicative triple collocation (MTC) method has been demonstrated powerful in error quantification of precipitation products when ground truth is not known. This study applied MTC to evaluate five precipitation products in Germany: two raw satellite-based products (CMORPH and PERSIANN), one reanalysis product (ERA-Interim), one soil moisture-based product (SM2RAIN-ASCAT), and one gauge-based product (REGNIE). Evaluation was performed at the 0.5 degrees daily spatial-temporal scales. MTC involves a log transformation of data, necessitating dealing with zero values in daily precipitation. Effects of 12 different strategies for dealing with zero values on MTC results were investigated. Seven different triplet combinations were tested to evaluate the stability of MTC. Results showed that different strategies for replacing zero values had considerable effects on MTC-derived error metrics, particularly for root-mean-square error (RMSE). MTC with different triplet combinations generated different error metrics for individual products. The MTC-derived correlation coefficient (CC) was more reliable than RMSE. It is more appropriate to use MTC to compare the relative accuracy of different precipitation products. Based on CC with unknown truth, MTC with different triplet combinations produced the same ranking of products as the traditional method. A comparison of results from MTC and the classic TC with additive error model showed the potential limitation of MTC in arid areas or dry time periods with a large ratio of zero daily precipitation.
What problem does this paper attempt to address?