Making use of the information in ensemble weather forecasts: comparing the end to end and full statistical modelling approaches

Stephen Jewson

DOI: https://doi.org/10.48550/arXiv.physics/0409097

2004-09-20

Abstract:We discuss how ensemble weather forecasts can be used, and highlight the advantages and disadvantages of two particular methods.

Atmospheric and Oceanic Physics

What problem does this paper attempt to address?

An Ensemble Forecasting Method For The Aggregated Load With Subprofiles

Yi Wang,Qixin Chen,Mingyang Sun,Chongqing Kang,Qing Xia

DOI: https://doi.org/10.1109/TSG.2018.2807985

IF: 10.275

2018-01-01

IEEE Transactions on Smart Grid

Abstract:With the prevalence of smart meters, fine-grained subprofiles reveal more information about the aggregated load and further help improve the forecasting accuracy. Ensemble is an effective approach for load forecasting. It either generates multiple training datasets or applies multiple forecasting models to produce multiple forecasts. In this letter, a novel ensemble method is proposed to forecast the aggregated load with subprofiles where the multiple forecasts are produced by different groupings of subprofiles. Specifically, the subprofiles are first clustered into different groups and forecasting is conducted on the grouped load profiles individually. Thus, these forecasts can he summed to firm the aggregated load forecast. In this way, different aggregated load forecasts can be obtained by varying the number of clusters. Finally, an optimal weighted ensemble approach is employed to combine these forecasts and provide the final forecasting result. Case studies are conducted on two open datasets and verify the effectiveness and superiority of the proposed method.
A seamless blended multi‐model ensemble approach to probabilistic medium‐range weather pattern forecasts over the UK

Robert Neal,Joanne Robbins,Ric Crocker,Dave Cox,Keith Fenwick,Jonathan Millard,Jason Kelly

DOI: https://doi.org/10.1002/met.2179

2024-02-20

Meteorological Applications

Abstract:This paper presents a framework for generating probabilistic weather pattern forecasts using a seamless blended multi‐model ensemble approach, to help speed up the decision‐making process for end‐users (e.g., operational meteorologists). Objective verification over a 6‐year period compares probabilistic weather pattern forecasts from separate ensemble systems (MOGREPS‐G, ECMWF medium‐range, GEFS, ECMWF extended‐range and GloSea) with those from a seamless blended multi‐model ensemble. Results show that the multi‐model ensemble forecasts are more skilful on average than the best performing individual model. This paper describes a new seamless blended multi‐model ensemble configuration of an existing probabilistic medium‐ to extended‐range weather pattern forecasting tool (called Decider) run operationally at the Met Office. In its initial configuration, the tool calculated and presented probabilistic weather pattern forecast information for five individual ensemble forecasting systems, which varied in terms of their number of ensemble members, horizontal resolution, update frequencies and forecast lead time. This resulted in multiple forecasts for the same validity time which varied in terms of forecast skill depending on the lead time in question. This presented challenges for end‐users (e.g., operational meteorologists) in terms of knowing which forecast output is best to use and at which lead time, as well as knowing what to do in situations where forecasts varied between ensembles. To get around these challenges, a new seamless blended multi‐model ensemble configuration has been implemented operationally, comprising of output from five separate ensembles, and provides a single best forecast from day one out to day 45. Objective verification for a set of eight weather pattern groups covering forecasts initialized over a 6‐year period (2017–2022) shows that the seamless blended multi‐model ensemble forecasts are at least as good as, if not better than the best performing individual model.

meteorology & atmospheric sciences
A two-step machine learning approach to statistical post-processing of weather forecasts for power generation

Ágnes Baran,Sándor Baran

DOI: https://doi.org/10.1002/qj.4635

2022-07-16

Abstract:By the end of 2021, the renewable energy share of the global electricity capacity reached 38.3% and the new installations are dominated by wind and solar energy, showing global increases of 12.7% and 18.5%, respectively. However, both wind and photovoltaic energy sources are highly volatile making planning difficult for grid operators, so accurate forecasts of the corresponding weather variables are essential for reliable electricity predictions. The most advanced approach in weather prediction is the ensemble method, which opens the door for probabilistic forecasting; though ensemble forecast are often underdispersive and subject to systematic bias. Hence, they require some form of statistical post-processing, where parametric models provide full predictive distributions of the weather variables at hand. We propose a general two-step machine learning-based approach to calibrating ensemble weather forecasts, where in the first step improved point forecasts are generated, which are then together with various ensemble statistics serve as input features of the neural network estimating the parameters of the predictive distribution. In two case studies based of 100m wind speed and global horizontal irradiance forecasts of the operational ensemble pre diction system of the Hungarian Meteorological Service, the predictive performance of this novel method is compared with the forecast skill of the raw ensemble and the state-of-the-art parametric approaches. Both case studies confirm that at least up to 48h statistical post-processing substantially improves the predictive performance of the raw ensemble for all considered forecast horizons. The investigated variants of the proposed two-step method outperform in skill their competitors and the suggested new approach is well applicable for different weather quantities and for a fair range of predictive distributions.

Machine Learning,Applications
Ensemble solar forecasting using data-driven models with probabilistic post-processing through GAMLSS

Gokhan Mert Yagli,Dazhi Yang,Dipti Srinivasan

DOI: https://doi.org/10.1016/j.solener.2020.07.040

IF: 7.188

2020-09-01

Solar Energy

Abstract:Forecast performance of data-driven models depends on the local weather and climate regime, which makes model selection a tedious task for forecast practitioners. Ensemble forecasting, or forecast combination, is beneficial in such cases, in that, forecasts from multiple models are combined to form a final forecast. In ensemble forecasting, additional to the final deterministic-style forecasts, predictive distributions are also available, which can be used by grid operators for better decision-making. Such empirical predictive distributions are useful to represent the uncertainty associated with the forecasts. However, raw ensemble forecasts are often not calibrated, e.g., due to the lack of diversity in the ensemble members. The lack of ensemble spread is known as underdispersion, and it can be ameliorated through post-processing.This study aims to calibrate hourly ensemble clear-sky index forecasts, generated by 20 data-driven models, using both parametric and nonparametric post-processing techniques. Four years of data collected at 7 research-grade sites are used in the empirical part of the paper. Quantitative and qualitative methods are used to evaluate the performance of post-processing techniques in terms of calibration and sharpness. Post-processed ensemble forecasts outperform raw ensemble forecasts under all verification metrics. The proposed parametric post-processing technique, namely, generalized additive models for location, scale and shape, substantially reduces the continuous ranked probability score (CRPS) of the raw ensemble forecasts from 32–59 W/m<math>2</math> to 25–45 W/m<math>2</math> and quantile score from 16–30 W/m<math>2</math> to 13–23 W/m<math>2</math>. In terms of CRPS skill score, the proposed method achieved 38–58% improvements over a climatology reference.

energy & fuels
The ensemble approach to forecasting: A review and synthesis

Hao Wu,David Levinson

DOI: https://doi.org/10.1016/j.trc.2021.103357

2021-11-01

Abstract:Ensemble forecasting is a modeling approach that combines data sources, models of different types, with alternative assumptions, using distinct pattern recognition methods. The aim is to use all available information in predictions, without the limiting and arbitrary choices and dependencies resulting from a single statistical or machine learning approach or a single functional form, or results from a limited data source. Uncertainties are systematically accounted for. Outputs of ensemble models can be presented as a range of possibilities, to indicate the amount of uncertainty in modeling. We review methods and applications of ensemble models both within and outside of transport research. The review finds that ensemble forecasting generally improves forecast accuracy, robustness in many fields, particularly in weather forecasting where the method originated. We note that ensemble methods are highly siloed across different disciplines, and both the knowledge and application of ensemble forecasting are lacking in transport. In this paper we review and synthesize methods of ensemble forecasting with a unifying framework, categorizing ensemble methods into two broad and not mutually exclusive categories, namely combining models, and combining data; this framework further extends to ensembles of ensembles. We apply ensemble forecasting to transport related cases, which shows the potential of ensemble models in improving forecast accuracy and reliability. This paper sheds light on the apparatus of ensemble forecasting, which we hope contributes to the better understanding and wider adoption of ensemble models.

transportation science & technology
Ensemble forecasting: A foray of dynamics into the realm of statistics

Jie Feng,Zoltan Toth,Jing Zhang,Malaquias Peña

DOI: https://doi.org/10.1002/qj.4745

2024-06-05

Quarterly Journal of the Royal Meteorological Society

Abstract:Statistical sampling, as we know it, works for single variables of the atmosphere. In one dimension (left panel), the distribution of reliable samples (blue curve) overlaps with the distribution of best guesses (black curve), and importantly, contains reality (red vertical line). In multidimensional spaces like resolved‐scale atmospheric dynamics (150 dimensions, right panel), sample points uniformly degrade the best estimate, so they do not contain reality. The attempt at capturing the evolution of the atmosphere with dynamically generated ensembles is futile. Uncertain quantities are often described through statistical samples. Can samples for numerical weather forecasts be generated dynamically? At a great expense, they can. With statistically constrained perturbations, a cloud of initial states is created and then integrated forward in time. By now, this technique has become ubiquitous in weather and climate research and operations. Ensembles are widely used, with demonstrated value. The atmosphere evolves in a multidimensional phase space. Does a cloud of ensemble solutions encompass the evolution of the real atmosphere? Theoretically, random perturbations in high‐dimensional spaces have negligible projection in any direction, including the error in the best estimate, therefore consistently degrading that. As the bulk of the perturbation variance lies in the null space of error, samples in multidimensional space do not contain reality. An evaluation suggests that initial and short‐range forecast error and ensemble perturbations are random draws from a high‐dimensional domain we call the subspace of possible error. Error in any initial condition is partly a result of stochastic observational and assimilation noise, while perturbations explore other, mostly independent directions from the subspace of possible error that may have resulted from other configurations of stochastic noise. What benefits may arise from the deterministic projection of such noise? Consistent with theoretical expectations, ensemble members consistently degrade the skill of the unperturbed forecast until medium range. The mean and all other products derived from ensembles suffer an 18‐hour loss in forecast Information. Since Information is a sufficient statistic, any rational user can benefit more from the unperturbed, than from an ensemble of weather forecasts. Furthermore, case‐dependent variations in the distribution or spread of ensembles have no impact on commonly used metrics. Can alternative, statistical applications provide comparable, or even higher‐quality probabilistic and other products, at the fraction of the cost of running an ensemble?

meteorology & atmospheric sciences
The Importance of Ensemble Techniques for Operational Space Weather Forecasting

Sophie A. Murray

DOI: https://doi.org/10.1029/2018sw001861

2018-07-01

Space Weather

Abstract:Abstract The space weather community has begun to use frontier methods such as data assimilation, machine learning, and ensemble modeling to advance current operational forecasting efforts. This was highlighted by a multidisciplinary session at the 2017 American Geophysical Union Meeting, Frontier Solar‐Terrestrial Science Enabled by the Combination of Data‐Driven Techniques and Physics‐Based Understanding , with considerable discussion surrounding ensemble techniques. Here ensemble methods are described in detail, using a set of predictions to improve on a single‐model output, for example, taking a simple average of multiple models, or using more complex techniques for data assimilation. They have been used extensively in fields such as numerical weather prediction and data science, for both improving model accuracy and providing a measure of model uncertainty. Researchers in the space weather community have found them to be similarly useful, and some examples of success stories are highlighted in this commentary. Future developments are also encouraged to transition these basic research efforts to operational forecasting as well as providing prediction errors to aid end‐user understanding. Plain Language Summary Space weather has the potential to impact a range of vital technologies and infrastructures that society has become dependent on in recent decades. Space weather forecasts receive the close attention of private companies, government policy makers, and even the general public hoping to spot aurorae. To that end, there is an increasing need to improve the accuracy of forecasts considering they currently do not perform as well compared to weather forecasts. The space weather community has begun to try using methods used by more established communities to aid these efforts, such as in meteorology and data science. Ensembles were a topic of interesting discussion at the 2017 American Geophysical Union session dedicated to presenting these frontier methods, a technique that combines multiple models to produce a more accurate result. They have thus far proven extremely useful to improve model accuracy, and also can easily provide an error with the issued forecast, giving end‐users a clearer picture of the real value of a forecast. This commentary encourages the continuing use of ensembles in space weather research and to transition these efforts to advance operational space weather forecasting.Key Points Ensemble modeling methods are well established in terrestrial weather forecasting and data science The application of ensemble methods to existing forecasts has improved their accuracy Ensemble techniques enable quantification of uncertainty in space weather predictions

English Else
A framework for probabilistic weather forecast post-processing across models and lead times using machine learning

Charlie Kirkwood,Theo Economou,Henry Odbert,Nicolas Pugeault

DOI: https://doi.org/10.1098/rsta.2020.0099

2021-02-15

Abstract:Forecasting the weather is an increasingly data-intensive exercise. Numerical weather prediction (NWP) models are becoming more complex, with higher resolutions, and there are increasing numbers of different models in operation. While the forecasting skill of NWP models continues to improve, the number and complexity of these models poses a new challenge for the operational meteorologist: how should the information from all available models, each with their own unique biases and limitations, be combined in order to provide stakeholders with well-calibrated probabilistic forecasts to use in decision making? In this paper, we use a road surface temperature example to demonstrate a three-stage framework that uses machine learning to bridge the gap between sets of separate forecasts from NWP models and the ‘ideal’ forecast for decision support: probabilities of future weather outcomes. First, we use quantile regression forests to learn the error profile of each numerical model, and use these to apply empirically derived probability distributions to forecasts. Second, we combine these probabilistic forecasts using quantile averaging. Third, we interpolate between the aggregate quantiles in order to generate a full predictive distribution, which we demonstrate has properties suitable for decision support. Our results suggest that this approach provides an effective and operationally viable framework for the cohesive post-processing of weather forecasts across multiple models and lead times to produce a well-calibrated probabilistic output. This article is part of the theme issue ‘Machine learning for weather and climate modelling’.
A new approach to extended‐range multimodel forecasting: Sequential learning algorithms

Paula L. M. Gonzalez,David J. Brayshaw,Florian Ziel

DOI: https://doi.org/10.1002/qj.4177

2021-10-01

Quarterly Journal of the Royal Meteorological Society

Abstract:Multi-model combinations are a well established methodology in weather and climate prediction and their benefits have been widely discussed in the literature. Typical approaches involve combining the output of different numerical weather prediction (NWP) models using constant weighting factors, either uniformly distributed or determined through a prior skill assessment. This strategy, however, can lead to sub-optimal levels of skill as the performance of NWP models can vary with time (e.g., seasonally varying skill, changes in the forecasting system). Moreover, standard combination methods are not designed to incorporate predictions derived from sources other than NWP systems (e.g., climatological or time-series forecasts).New algorithms developed within the Machine Learning community provide the opportunity for 'online prediction' (also referred to as 'sequential learning'). These methods consider a set of weighted predictors or 'experts' to produce subsequent predictions in which the combination or 'mixture' is updated at each step to optimize a loss or skill function. The predictors are highly flexible and can transparently combine both NWP- and statistically- derived forecasts.A set of these online prediction methods are tested and compared to standard multi-model combination techniques to assess their usefulness. The methods are general and can be applied to any model-derived predictand. A set of weather-sensitive European country-aggregate energy variables (electricity demand and wind power) are selected for demonstration purposes. Results show that these innovative methods exhibit significant skill improvements (i.e., between 5% and 15% improvement in the probabilistic skill) with respect to standard multi-model combination techniques for lead weeks up to 5. The incorporation of statistically-derived predictors (based on historical climate data) alongside NWP forecasts are also shown to contribute significant skill improvements in many cases.

meteorology & atmospheric sciences
Probabilistic Quantitative Precipitation Forecasting Using Ensemble Model Output Statistics

Michael Scheuerer

DOI: https://doi.org/10.1002/qj.2183

2013-02-05

Abstract:Statistical post-processing of dynamical forecast ensembles is an essential component of weather forecasting. In this article, we present a post-processing method that generates full predictive probability distributions for precipitation accumulations based on ensemble model output statistics (EMOS). We model precipitation amounts by a generalized extreme value distribution that is left-censored at zero. This distribution permits modelling precipitation on the original scale without prior transformation of the data. A closed form expression for its continuous rank probability score can be derived and permits computationally efficient model fitting. We discuss an extension of our approach that incorporates further statistics characterizing the spatial variability of precipitation amounts in the vicinity of the location of interest. The proposed EMOS method is applied to daily 18-h forecasts of 6-h accumulated precipitation over Germany in 2011 using the COSMO-DE ensemble prediction system operated by the German Meteorological Service. It yields calibrated and sharp predictive distributions and compares favourably with extended logistic regression and Bayesian model averaging which are state of the art approaches for precipitation post-processing. The incorporation of neighbourhood information further improves predictive performance and turns out to be a useful strategy to account for displacement errors of the dynamical forecasts in a probabilistic forecasting framework.

Applications,Atmospheric and Oceanic Physics
Optimising the use of ensemble information in numerical weather forecasts of wind power generation

J Stanger,I Finney,A Weisheimer,T Palmer

DOI: https://doi.org/10.1088/1748-9326/ab5e54

IF: 6.7

2019-12-01

Environmental Research Letters

Abstract:Abstract Electricity generation output forecasts for wind farms across Europe use numerical weather prediction (NWP) models. These forecasts influence decisions in the energy market, some of which help determine daily energy prices or the usage of thermal power generation plants. The predictive skill of power generation forecasts has an impact on the profitability of energy trading strategies and the ability to decrease carbon emissions. Probabilistic ensemble forecasts contain valuable information about the uncertainties in a forecast. The energy market typically takes basic approaches to using ensemble data to obtain more skilful forecasts. There is, however, evidence that more sophisticated approaches could yield significant further improvements in forecast skill and utility. In this letter, the application of ensemble forecasting methods to the aggregated electricity generation output for wind farms across Germany is investigated using historical ensemble forecasts from the European Centre for Medium-Range Weather Forecasting (ECMWF). Multiple methods for producing a single forecast from the ensemble are tried and tested against traditional deterministic methods. All the methods exhibit positive skill, relative to a climatological forecast, out to a lead time of at least seven days. A wind energy trading strategy involving ensemble data is implemented and produces significantly more profit than trading strategies based on single forecasts. It is thus found that ensemble spread is a good predictor for wind electricity generation output forecast uncertainty and is extremely valuable at informing wind energy trading strategy.

environmental sciences,meteorology & atmospheric sciences
Lead‐time‐continuous statistical postprocessing of ensemble weather forecasts

Jakob Benjamin Wessel,Christopher A. T. Ferro,Frank Kwasniok

DOI: https://doi.org/10.1002/qj.4701

2024-04-01

Quarterly Journal of the Royal Meteorological Society

Abstract:Statistical postprocessing methods for recalibrating forecasts are usually fitted individually for each lead time at which a forecast is available. This, however, is computationally expensive and restricts the usability of models. Here we study the lead‐time dependence of Ensemble Model Output Statistics—a postprocessing method—and develop lead‐time‐continuous postprocessing models that are usable to correct forecasts at different lead times simultaneously. These models save substantially on computation time and show improved performance in small data situations/running‐window training schemes. Numerical weather prediction (NWP) ensembles often exhibit biases and errors in dispersion, so they need some form of postprocessing to yield sharp and well‐calibrated probabilistic predictions. The output of NWP models is usually at a multiplicity of different lead times and, even though information is often required on this range of lead times, many postprocessing methods in the literature are applied either at a fixed lead time or by fitting individual models for each lead time. However, this is (1) computationally expensive because it requires the training of multiple models if users are interested in information at multiple lead times and (2) prohibitive because it restricts the data used for training postprocessing models and the usability of fitted models. This article investigates the lead‐time dependence of postprocessing methods in the idealized Lorenz'96 system as well as temperature and wind‐speed forecast data from the Met Office Global and Regional Ensemble Prediction System (MOGREPS‐G). The results indicate that there is substantial regularity between the models fitted for different lead times and that one can fit models that are lead‐time‐continuous that work for multiple lead times simultaneously by including lead time as a covariate. These models achieve similar and, in small data situations, even improved performance compared with the classical lead‐time‐separated models, whilst saving substantial computation time.

meteorology & atmospheric sciences
A data-driven multi-model ensemble for deterministic and probabilistic precipitation forecasting at seasonal scale

Lei Xu,Nengcheng Chen,Xiang Zhang,Zeqiang Chen

DOI: https://doi.org/10.1007/s00382-020-05173-x

IF: 4.901

2020-02-17

Climate Dynamics

Abstract:Seasonal precipitation forecasting is valuable for regional water management and agricultural food security. Current numerical models have large uncertainty in model structure, parameterization and initial conditions. Here, a data-driven multi-model ensemble is constructed using a series of statistical and machine learning methods with varying inputs. Deterministic precipitation forecasts are produced by the weighting of ensemble members using Bayesian model averaging (BMA) and probabilistic forecasts are generated by sampling from BMA predictive probability density function (PDF). Three mathematical metrics are used to evaluate the performance of precipitation forecasts, including Pearson's correlation coefficient (PCC), root mean square error skill score (RMSESS) and continuous ranked probability skill score (CRPSS). The results demonstrate that the accuracy in the statistical ensemble is significantly higher than the North American multi-model ensemble (NMME) for both deterministic and probabilistic precipitation forecasts, especially at 1-month lead. Statistical models are considerably enhanced by incorporating wavelets, which decomposes the raw precipitation series into several different levels, potentially representing underlying precipitation patterns at different time-frequency scales. Selecting some good ensemble members can improve the ensemble performance, instead of including all the ensemble members with some inefficient models. Overall, the statistical ensemble can be considered as an effective complement of numerical models in both deterministic and probabilistic precipitation forecasts.

meteorology & atmospheric sciences
Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operators

Ankur Mahesh,William Collins,Boris Bonev,Noah Brenowitz,Yair Cohen,Joshua Elms,Peter Harrington,Karthik Kashinath,Thorsten Kurth,Joshua North,Travis OBrien,Michael Pritchard,David Pruitt,Mark Risser,Shashank Subramanian,Jared Willard

2024-08-06

Abstract:Studying low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1,000-10,000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part I, we construct an ensemble weather forecasting system based on Spherical Fourier Neural Operators (SFNO), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. Using large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states, and the ML ensemble thus passes a crucial spectral test in the literature. The IFS and ML ensembles have similar Extreme Forecast Indices, and we show that the ML extreme weather forecasts are reliable and discriminating.

Atmospheric and Oceanic Physics
Evaluating Ensemble Post-Processing for Wind Power Forecasts

Kaleb Phipps,Sebastian Lerch,Maria Andersson,Ralf Mikut,Veit Hagenmeyer,Nicole Ludwig

DOI: https://doi.org/10.1002/we.2736

2022-04-25

Abstract:Capturing the uncertainty in probabilistic wind power forecasts is challenging, especially when uncertain input variables, such as the weather, play a role. Since ensemble weather predictions aim to capture the uncertainty in the weather system, they can be used to propagate this uncertainty through to subsequent wind power forecasting models. However, as weather ensemble systems are known to be biased and underdispersed, meteorologists post-process the ensembles. This post-processing can successfully correct the biases in the weather variables but has not been evaluated thoroughly in the context of subsequent forecasts, such as wind power generation forecasts. The present paper evaluates multiple strategies for applying ensemble post-processing to probabilistic wind power forecasts. We use Ensemble Model Output Statistics (EMOS) as the post-processing method and evaluate four possible strategies: only using the raw ensembles without post-processing, a one-step strategy where only the weather ensembles are post-processed, a one-step strategy where we only post-process the power ensembles, and a two-step strategy where we post-process both the weather and power ensembles. Results show that post-processing the final wind power ensemble improves forecast performance regarding both calibration and sharpness, whilst only post-processing the weather ensembles does not necessarily lead to increased forecast performance.

Applications
Supermodeling: improving predictions with an ensemble of interacting models

Francine Schevenhoven,Noel Keenlyside,François Counillon,Alberto Carrassi,William E. Chapman,Marion Devilliers,Alok Gupta,Shunya Koseki,Frank Selten,Mao-Lin Shen,Shuo Wang,Jeffrey B. Weiss,Wim Wiegerinck,Gregory S. Duane

DOI: https://doi.org/10.1175/bams-d-22-0070.1

IF: 9.116

2023-08-09

Bulletin of the American Meteorological Society

Abstract:The modeling of weather and climate has been a success story. The skill of forecasts continues to improve and model biases continue to decrease. Combining the output of multiple models has further improved forecast skill and reduced biases. But are we exploiting the full capacity of state-of-the-art models in making forecasts and projections? Supermodeling is a recent step forward in the multi-model ensemble approach. Instead of combining model output after the simulations are completed, in a supermodel individual models exchange state information as they run, influencing each other's behavior. By learning the optimal parameters that determine how models influence each other based on past observations, model errors are reduced at an early stage before they propagate into larger scales and affect other regions and variables. The models synchronize on a common solution that through learning remains closer to the observed evolution. Effectively a new dynamical system has been created, a supermodel, that optimally combines the strengths of the constituent models. The supermodel approach has the potential to rapidly improve current state-of-the-art weather forecasts and climate predictions. In this paper we introduce supermodeling, demonstrate its potential in examples of various complexity and discuss learning strategies. We conclude with a discussion of remaining challenges for a successful application of supermodeling in the context of state-of-the-art models. The supermodeling approach is not limited to the modeling of weather and climate, but can be applied to improve the prediction capabilities of any complex system, for which a set of different models exist.

meteorology & atmospheric sciences
A Foray of Dynamics into the Realm of Statistics: A Review of Ensemble Forecasting

Zoltan Toth,Jie Feng,Jing Zhang,Malaquias Pena

DOI: https://doi.org/10.5194/egusphere-egu24-6791

2024-01-01

Abstract:Uncertain quantities are often described through statistical samples. Can samples for numerical weather forecasts be generated dynamically? At a great expense, they can. With statistically constrained perturbations, a cloud of initial states are created and then integrated forward in time. By now, this technique has become ubiquitous in weather and climate research and operations. Ensembles are widely used, with demonstrated value. The atmosphere evolves in a multidimensional phase space. Does a cloud of ensemble solutions encompass the evolution of the real atmosphere? Theoretically, random perturbations in high dimensional spaces have negligible projection on any direction, including the error in the best estimate, therefore consistently degrading it. As the bulk of the perturbation variance lies in the null-space of error, samples in multidimensional space do not contain reality. An evaluation suggests that initial and short-range forecast error and ensemble perturbations are random draws from a high dimensional domain we call the subspace of possible error. Error in any initial condition is a result of stochastic observational and assimilation noise, while perturbations explore other, mostly independent directions from the subspace of possible error that may have resulted from other configurations of stochastic noise. What benefits may arise from the deterministic projection of such noise? 
Ensemble methods for wind and solar power forecasting—A state-of-the-art review

Ye Ren,P.N. Suganthan,N. Srikanth

DOI: https://doi.org/10.1016/j.rser.2015.04.081

IF: 16.799

2015-10-01

Renewable and Sustainable Energy Reviews

Abstract:This paper reviews state-of-the-art on wind speed/power forecasting and solar irradiance forecasting with ensemble methods. The ensemble forecasting methods are grouped into two main categories: competitive ensemble forecasting and cooperative ensemble forecasting. The competitive ensemble forecasting is further categorized based on data diversity and parameter diversity. The cooperative ensemble forecasting is divided according to pre-processing and post-processing. Typical articles are discussed according to each category and their characteristics are highlighted. We also conduct comparisons based on reported results and comparisons based on simulations conducted by us. Suggestions for future research include ensemble of different paradigms and inter-category ensemble methods among others.

energy & fuels,green & sustainable science & technology
An ensemble of data-driven weather prediction models for operational sub-seasonal forecasting

Jonathan A. Weyn,Divya Kumar,Jeremy Berman,Najeeb Kazmi,Sylwester Klocek,Pete Luferenko,Kit Thambiratnam

2024-03-23

Abstract:We present an operations-ready multi-model ensemble weather forecasting system which uses hybrid data-driven weather prediction models coupled with the European Centre for Medium-range Weather Forecasts (ECMWF) ocean model to predict global weather at 1-degree resolution for 4 weeks of lead time. For predictions of 2-meter temperature, our ensemble on average outperforms the raw ECMWF extended-range ensemble by 4-17%, depending on the lead time. However, after applying statistical bias corrections, the ECMWF ensemble is about 3% better at 4 weeks. For other surface parameters, our ensemble is also within a few percentage points of ECMWF's ensemble. We demonstrate that it is possible to achieve near-state-of-the-art subseasonal-to-seasonal forecasts using a multi-model ensembling approach with data-driven weather prediction models.

Atmospheric and Oceanic Physics,Machine Learning
Bivariate ensemble model output statistics approach for joint forecasting of wind speed and temperature

Sándor Baran,Annette Möller

DOI: https://doi.org/10.1007/s00703-016-0467-8

2015-07-27

Abstract:Forecast ensembles are typically employed to account for prediction uncertainties in numerical weather prediction models. However, ensembles often exhibit biases and dispersion errors, thus they require statistical post-processing to improve their predictive performance. Two popular univariate post-processing models are the Bayesian model averaging (BMA) and the ensemble model output statistics (EMOS). In the last few years increased interest has emerged in developing multivariate post-processing models, incorporating dependencies between weather quantities, such as for example a bivariate distribution for wind vectors or even a more general setting allowing to combine any types of weather variables. In line with a recently proposed approach to model temperature and wind speed jointly by a bivariate BMA model, this paper introduces a bivariate EMOS model for these weather quantities based on a truncated normal distribution. The bivariate EMOS model is applied to temperature and wind speed forecasts of the eight-member University of Washington mesoscale ensemble and of the eleven-member ALADIN-HUNEPS ensemble of the Hungarian Meteorological Service and its predictive performance is compared to the performance of the bivariate BMA model and a multivariate Gaussian copula approach, post-processing the margins with univariate EMOS. While the predictive skills of the compared methods are similar, the bivariate EMOS model requires considerably lower computation times than the bivariate BMA method.

Applications

Making use of the information in ensemble weather forecasts: comparing the end to end and full statistical modelling approaches

An Ensemble Forecasting Method For The Aggregated Load With Subprofiles

A seamless blended multi‐model ensemble approach to probabilistic medium‐range weather pattern forecasts over the UK

A two-step machine learning approach to statistical post-processing of weather forecasts for power generation

Ensemble solar forecasting using data-driven models with probabilistic post-processing through GAMLSS

The ensemble approach to forecasting: A review and synthesis

Ensemble forecasting: A foray of dynamics into the realm of statistics

The Importance of Ensemble Techniques for Operational Space Weather Forecasting

A framework for probabilistic weather forecast post-processing across models and lead times using machine learning

A new approach to extended‐range multimodel forecasting: Sequential learning algorithms

Probabilistic Quantitative Precipitation Forecasting Using Ensemble Model Output Statistics

Optimising the use of ensemble information in numerical weather forecasts of wind power generation

Lead‐time‐continuous statistical postprocessing of ensemble weather forecasts

A data-driven multi-model ensemble for deterministic and probabilistic precipitation forecasting at seasonal scale

Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operators

Evaluating Ensemble Post-Processing for Wind Power Forecasts

Supermodeling: improving predictions with an ensemble of interacting models

A Foray of Dynamics into the Realm of Statistics: A Review of Ensemble Forecasting

Ensemble methods for wind and solar power forecasting—A state-of-the-art review

An ensemble of data-driven weather prediction models for operational sub-seasonal forecasting

Bivariate ensemble model output statistics approach for joint forecasting of wind speed and temperature