Abstract:With the development of refined numerical forecasts, problems such as score distortion due to the division of precipitation thresholds in both traditional and improved scoring methods for precipitation forecasts and the increasing subjective risk arising from the scale setting of the neighborhood spatial verification method have become increasingly prominent. To address these issues, a general comprehensive evaluation method (GCEM) is developed for cross-scale precipitation forecasts by directly analyzing the proximity of precipitation forecasts and observations in this study. In addition to the core indicator of the precipitation accuracy score (PAS), the GCEM system also includes score indices for insufficient precipitation forecasts, excessive precipitation forecasts, precipitation forecast biases, and clear/rainy forecasts. The PAS does not distinguish the magnitude of precipitation and does not delimit the area of influence; it constitutes a fair scoring formula with objective performance and can be suitable for evaluating rainfall events such as general and extreme precipitation. The PAS can be used to calculate the accuracy of numerical models or quantitative precipitation forecasts, enabling the quantitative evaluation of the comprehensive capability of various refined precipitation forecasting products. Based on the GCEM, comparative experiments between the PAS and threat score (TS) are conducted for two typical precipitation weather processes. The results show that relative to the TS, the PAS better aligns with subjective expectations, indicating that the PAS is more reasonable than the TS. In the case of an extreme-precipitation event in Henan, China, two high-resolution models were evaluated using the PAS, TS, and fraction skill score (FSS), verifying the evaluation ability of PAS scoring for predicting extreme-precipitation events. In addition, other indices of the GCEM are utilized to analyze the range and extent of both insufficient and excessive forecasts of precipitation, as well as the precipitation forecasting ability for different weather processes. These indices not only provide overall scores similar to those of the TS for individual cases but also support two-dimensional score distribution plots which can comprehensively reflect the performance and characteristics of precipitation forecasts. Both theoretical and practical applications demonstrate that the GCEM exhibits distinct advantages and potential promotion and application value compared to the various mainstream precipitation forecast verification methods.

Application of Monte Carlo significance test in precipitation skill score

Application of an Improved Adaptive Importance Sampling Method in Extreme Hydrological Analysis

Evaluation of a Multi-Site Weather Generator in Simulating Precipitation in the Qiantang River Basin, East China

Post-processing of numerical precipitation forecast based on spatial-temporal deep learning model

Stochastic Generation of Daily Rainfall Events: A Single-Site Rainfall Model with Copula-based Joint Simulation of Rainfall Characteristics and Classification and Simulation of Rainfall Patterns

A general comprehensive evaluation method for cross-scale precipitation forecasts

SAL Method Applied in Grid Forecasting Product Verification with Three-Source Fusion Product

Using New Neighborhood-Based Intensity-Scale Verification Metrics to Evaluate WRF Precipitation Forecasts at 4 and 12 Km Grid Spacings

Technical Evaluation of Precipitation Forecast by Blending Weather Radar Based on New Spatial Test Method

Evaluation of summer daily precipitation forecast over eastern China based on subseasonal to seasonal (S2S)models

A comparison of the reproducibility of regional precipitation properties simulated respectively by weather generators and stochastic simulation methods

Spatial Spread-Skill Relationship in Terms of Agreement Scales for Precipitation Forecasts in a Convection-Allowing Ensemble

Verification of GRAPES Unified Global and Regional Numerical Weather Prediction Model Dynamic Core

Accuracy Validation of TRMM Precipitation Data in Shaxi River Basin

Improving subseasonal-to-seasonal forecasts in predicting the occurrence of extreme precipitation events over the contiguous U.S. using machine learning models

Deterministic and probabilistic evaluation of raw and post-processing monthly precipitation forecasts: a case study of China

A new scheme for probabilistic forecasting with an ensemble model based on CEEMDAN and AM-MCMC and its application in precipitation forecasting

Multiple Spatial and Temporal Scales Evaluation of Eight Satellite Precipitation Products in a Mountainous Catchment of South China

Evaluation of Subseasonal-to-Seasonal (S2S) precipitation forecast from the North American Multi-Model ensemble phase II (NMME-2) over the contiguous U.S.

Improving categorical and continuous accuracy of precipitation forecasts by integrating Empirical Quantile Mapping and Bernoulli-Gamma-Gaussian distribution

Evaluation of GSMaP Version 8 Precipitation Products on an Hourly Timescale over Mainland China