Spatial verification of global precipitation forecasts

Gregor Skok,Llorenç Lledó

2024-07-30

Abstract:Spatial verification of global high-resolution weather forecasts remains a considerable challenge. Most existing spatial verification techniques either do not properly account for the non-planar geometry of a global domain or their computation complexity becomes too large. We present an adaptation of the recently developed Precipitation Attribution Distance (PAD) metric, designed for verifying precipitation, enabling its use on the Earth's spherical geometry. PAD estimates the magnitude of location errors in the forecasts and is related to the mathematical theory of Optimal Transport as it provides a close upper bound for the Wasserstein distance. The method is fast and flexible with time complexity $O(n \log(n))$. Its behavior is analyzed using a set of idealized cases and 7 years of operational global high-resolution deterministic 6-hourly precipitation forecasts from the Integrated Forecasting System (IFS) of the European Centre for Medium-Range Weather Forecasts. The summary results for the whole period show how location errors in the IFS model grow steadily with increasing lead time for all analyzed regions. Moreover, by examining the time evolution of the results, we can determine the trends in the score's value and identify the regions where there is a statistically significant improvement (or worsening) of the forecast performance. The results can also be analyzed separately for different intensities of precipitation. Overall, the PAD provides meaningful results for estimating location errors in global high-resolution precipitation forecasts at an affordable computational cost.

Atmospheric and Oceanic Physics

What problem does this paper attempt to address?

The paper aims to address the issue of spatial verification in global high-resolution weather forecasts, particularly for precipitation forecasts. Currently, most spatial verification techniques either fail to correctly handle non-planar geometry (i.e., the spherical shape of the Earth) when dealing with global data or have computational complexities that are too high, making their application in the current state-of-the-art global high-resolution models impractical. The paper proposes an improved Precipitation Attribution Distance (PAD) metric and adapts it to the spherical geometry of the Earth. The PAD metric can estimate positional errors in forecasts and is related to optimal transport theory, providing an upper bound estimate close to the Wasserstein distance. This method is fast and flexible, with a time complexity of O(nlog(n)). Specifically, the paper analyzes the behavior of PAD through a series of idealized cases and conducts an empirical study using 7 years of operational data from the European Centre for Medium-Range Weather Forecasts (ECMWF) Integrated Forecast System (IFS). The results show that the positional error of the IFS model gradually increases with the forecast lead time. Additionally, by analyzing the temporal evolution of the results, trends in forecast performance improvement or deterioration in different regions can be identified. The PAD metric can provide meaningful results for positional errors in global high-resolution precipitation forecasts at a relatively low computational cost.

Spatial verification of global precipitation forecasts

A Novel Real-Time Error Adjustment Method With Considering Four Factors for Correcting Hourly Multi-Satellite Precipitation Estimates

Paired Satellite and NWP Precipitation for Global Flood Forecasting

Scale-Dependent Uncertainties in Global QPFs and QPEs from NWP Model and Satellite Fields

Hydrologic Evaluation of the Global Precipitation Measurement Mission over the U.S.: Effect of Spatial and Temporal Scales

High-resolution global precipitation downscaling with latent Gaussian models and non-stationary stochastic partial differential equation structure

A CRPS-Based Spatial Technique for the Verification of Ensemble Precipitation Forecasts

Hydrological verification of two rainfall short-term forecasting methods with floods anticipation perspective

On the Forecast Skill of A Convection-Permitting Ensemble

An Improved Strategy for Real-Time Troposphere Estimation and Its Application in the Severe Weather Event Monitoring

Area-covering postprocessing of ensemble precipitation forecasts using topographical and seasonal conditions

Using New Neighborhood-Based Intensity-Scale Verification Metrics to Evaluate WRF Precipitation Forecasts at 4 and 12 Km Grid Spacings

Spatial Solar Forecast Verification with the Neighborhood Method and Automatic Threshold Segmentation

Probabilistic quantitative precipitation field forecasting using a two-stage spatial model

Statistical Post-Processing with Standardized Anomalies Based on a 1 Km Gridded Analysis

The Evaluation of Rainfall Forecasting in a Global Navigation Satellite System-Assisted Numerical Weather Prediction Model

Accounting for Spatiotemporal Errors of Gauges: A Critical Step to Evaluate Gridded Precipitation Products

MCSPF-Net: A Precipitation Forecasting Method Using Multi-Channel Cloud Observations of FY-4A Satellite by 3D Convolution Neural Network

Multitask Learning for Precipitation Estimation Using Satellite Observations from the GOES-R Series

Weighted verification tools to evaluate univariate and multivariate forecasts for high-impact weather events

Spatial Verification Using Wavelet Transforms: A Review