Abstract:Forecasting the weather is an increasingly data-intensive exercise. Numerical weather prediction (NWP) models are becoming more complex, with higher resolutions, and there are increasing numbers of different models in operation. While the forecasting skill of NWP models continues to improve, the number and complexity of these models poses a new challenge for the operational meteorologist: how should the information from all available models, each with their own unique biases and limitations, be combined in order to provide stakeholders with well-calibrated probabilistic forecasts to use in decision making? In this paper, we use a road surface temperature example to demonstrate a three-stage framework that uses machine learning to bridge the gap between sets of separate forecasts from NWP models and the ‘ideal’ forecast for decision support: probabilities of future weather outcomes. First, we use quantile regression forests to learn the error profile of each numerical model, and use these to apply empirically derived probability distributions to forecasts. Second, we combine these probabilistic forecasts using quantile averaging. Third, we interpolate between the aggregate quantiles in order to generate a full predictive distribution, which we demonstrate has properties suitable for decision support. Our results suggest that this approach provides an effective and operationally viable framework for the cohesive post-processing of weather forecasts across multiple models and lead times to produce a well-calibrated probabilistic output. This article is part of the theme issue ‘Machine learning for weather and climate modelling’.

A general framework for multi-step ahead adaptive conformal heteroscedastic time series forecasting

Ensemble Conformalized Quantile Regression for Probabilistic Time Series Forecasting

Conformal PID Control for Time Series Prediction

Copula Conformal Prediction for Multi-step Time Series Forecasting

Adaptive Conformal Predictions for Time Series

Adaptive Conformal Inference for Multi-Step Ahead Time-Series Forecasting Online

A Composite Quantile Fourier Neural Network for Multi-Step Probabilistic Forecasting of Nonstationary Univariate Time Series

Conformal Prediction with Temporal Quantile Adjustments

CAMul: Calibrated and Accurate Multi-view Time-Series Forecasting

Conformal prediction for multi-dimensional time series by ellipsoidal sets

Enhancing reliability in prediction intervals using point forecasters: Heteroscedastic Quantile Regression and Width-Adaptive Conformal Inference

Conformalized Adaptive Forecasting of Heterogeneous Trajectories

A framework for probabilistic weather forecast post-processing across models and lead times using machine learning

Multi-output Ensembles for Multi-step Forecasting

Conformal Prediction Regions for Time Series using Linear Complementarity Programming

JANET: Joint Adaptive predictioN-region Estimation for Time-series

Adaptive Conformal Prediction by Reweighting Nonconformity Score

Beyond Conformal Predictors: Adaptive Conformal Inference with Confidence Predictors

Ensemble Modeling for Time Series Forecasting: an Adaptive Robust Optimization Approach

Robust Multi-Dimensional Time Series Forecasting

Empirical Risk Minimization for Time Series: Nonparametric Performance Bounds for Prediction