Addressing challenges associated with training sample sizes for effective calibration of NWP precipitation forecasts

Qichun Yang,Quan J Wang,Andrew W. Western,Tristan Graham
DOI: https://doi.org/10.1175/mwr-d-23-0159.1
2024-10-09
Monthly Weather Review
Abstract:Effective calibration of precipitation forecasts produced by numerical weather prediction (NWP) models faces challenges associated with the training sample size. Newly-operationalized NWP models may only accumulate a small number of forecasts and thus may limit robust parameter inference in forecast calibration. It is necessary to investigate how the performance of forecast calibration changes with the amount of training data, to determine an effective training sample size. In this study, we thoroughly investigate the impacts of training sample size on precipitation forecast calibration based on the Seasonally Coherent Calibration (SCC) model across Australia. Overall, the performance of the model tends to stabilize in most parts of Australia when raw forecasts of 10 months or longer are used for parameter inference. Whether the training dataset cover wet months substantially affects forecast calibration. The findings of this study are critical for understanding the impacts of training sample size on forecast calibration, and will provide implications for future forecast calibration and the generation of hindcasts.
meteorology & atmospheric sciences
What problem does this paper attempt to address?