Abstract:We explore a novel methodology for user‐oriented verification of weather patterns within polar lows. To separate the effect of errors in the weather patterns in relation to the polar low centre from errors in polar low location or direction of motion, the forecasts are centred at the low‐pressure centre and rotated according to the direction of the background flow. Then, we obtain metrics for size, shape, and location of areas with strong wind speed by applying feature‐based verification methods. Polar lows exhibit features with very sharp weather contrasts. In weather forecasting, a small misplacement of areas with hazardously high wind speeds can have fatal impacts for people living in polar regions. Therefore, a novel application of spatial verification methods for objective metrics of size, shape, and location of areas with hazardous weather is tested. To separate the effect of errors in polar low location and direction of motion from errors relative to the polar low centre, surface wind fields from the limited‐area weather forecasting model Applications of Research to Operations at Mesoscale‐Arctic and Copernicus Climate Change Service Arctic Regional Reanalysis are centred at the polar low centre and rotated according to the direction of background flow surrounding the polar low. Then the possibilities of the features‐based verification methods SAL (structure, amplitude, location) and MODE (Method for Object‐based Diagnostic Evaluation) are explored using a test case from October 2019. The study demonstrates that the methodology can provide valuable information about forecast performance. MODE is a flexible method with metrics that focus on characteristics of individual objects and can be adapted to questions at hand. For example, a measure of storm eye size was added. SAL, on the other hand, provides effective summary metrics for the full domain and proved particularly useful for evaluation of the overall distribution of wind speed. To evaluate the number of correctly or incorrectly identified areas with harsh weather rather than their details about their shape, contingency scores are more suitable. Applied to a larger dataset, this methodology can assess performance as a function of forecast length, as well as geographical area, and the type of polar low. The methodology can also be applied to other types of low‐pressure systems, such as extratropical cyclones.

Weighted verification tools to evaluate univariate and multivariate forecasts for high-impact weather events

Review article: Observations for high-impact weather and their use in verification

Validating Deep-Learning Weather Forecast Models on Recent High-Impact Extreme Events

Seamless Prediction of High-Impact Weather Events: A Comparison of Actionable Forecasts

Evaluating probabilistic forecasts of extremes using continuous ranked probability score distributions

A Multivariate Regression Load Forecasting Algorithm Based on Variable Accuracy Feedback

A Mutual Information Theory‐Based Approach for Assessing Uncertainties in Deterministic Multi‐Category Precipitation Forecasts

Evaluation of an experimental Warn‐on‐Forecast 3DVAR analysis and forecast system on quasi‐real‐time short‐term forecasts of high‐impact weather events

Revealing the Statistics of Extreme Events Hidden in Short Weather Forecast Data

Improving probabilistic forecasts of extreme wind speeds by training statistical post-processing models with weighted scoring rules

A Geospatial Verification Method for Severe Convective Weather Warnings: Implications for Current and Future Warning Methods

Assessing the calibration of multivariate probabilistic forecasts

Challenges of Operational Weather Forecast Verification and Evaluation

Developing a methodology for user‐oriented verification of polar low forecasts

Spatial verification of global precipitation forecasts

Multiscale Forecasting of High-Impact Weather: Current Status and Future Challenges

Spatially-Dependent Multiple Testing Under Model Misspecification, with Application to Detection of Anthropogenic Influence on Extreme Climate Events

A Machine Learning Approach to Improve the Usability of Severe Thunderstorm Wind Reports

Calibration of Deterministic NWP Forecasts and Its Impact on Verification

Verif: A weather-prediction verification tool for effective product development

Weighted scoringRules: Emphasising Particular Outcomes when Evaluating Probabilistic Forecasts