Abstract:We consider the problem of online prediction when it is uncertain what the best prediction model to use is. We develop a method called Dynamic Model Averaging (DMA) in which a state space model for the parameters of each model is combined with a Markov chain model for the correct model. This allows the "correct" model to vary over time. The state space and Markov chain models are both specified in terms of forgetting, leading to a highly parsimonious representation. As a special case, when the model and parameters do not change, DMA is a recursive implementation of standard Bayesian model averaging, which we call recursive model averaging. The method is applied to the problem of predicting the output strip thickness for a cold rolling mill, where the output is measured with a time delay. We found that when only a small number of physically motivated models were considered and one was clearly best, the method quickly converged to the best model, and the cost of model uncertainty was small; indeed DMA performed slightly better than the best physical model. When model uncertainty and the number of models considered were large, our method ensured that the penalty for model uncertainty was small. At the beginning of the process, when control is most difficult, we found that DMA over a large model space led to better predictions than the single best performing physically motivated model. We also applied the method to several simulated examples, and found that it recovered both constant and time-varying regression parameters and model specifications quite well.

Dynamic Model Averaging for Bayesian Quantile Regression

Bayesian Dynamic Quantile Model Averaging

Dynamic Model Averaging in Large Model Spaces Using Dynamic Occam's Window

AN OVERVIEW OF DYNAMIC MODEL AVERAGING TECHNIQUES IN TIME‐SERIES ECONOMETRICS

Model Switching and Model Averaging in Time-Varying Parameter Regression Models

Adaptive Dynamic Model Averaging with an Application to House Price Forecasting

Jackknife Model Averaging for Mixed-Data Kernel-Weighted Spline Quantile Regressions

Dynamic Model Averaging in Economics and Finance with fDMA: A Package for R

Online Prediction Under Model Uncertainty via Dynamic Model Averaging: Application to a Cold Rolling Mill

Penalized Time-Varying Model Averaging

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Semiparametric model averaging for high dimensional conditional quantile prediction

Flexible Bayesian quantile regression for nonlinear mixed effects models based on the generalized asymmetric Laplace distribution

A Conceptual Introduction to Bayesian Model Averaging

Ensemble Bayesian model averaging using Markov Chain Monte Carlo sampling

Dynamic Latent Class Model Averaging for Online Prediction

Model-averaging-based semiparametric modeling for conditional quantile prediction

Likelihood Tempering in Dynamic Model Averaging