Adaptive time series forecasting with markovian variance switching

Baptiste Abélès,Joseph de Vilmarest,Olivier Wintemberger
2024-02-23
Abstract:Adaptive time series forecasting is essential for prediction under regime changes. Several classical methods assume linear Gaussian state space model (LGSSM) with variances constant in time. However, there are many real-world processes that cannot be captured by such models. We consider a state-space model with Markov switching variances. Such dynamical systems are usually intractable because of their computational complexity increasing exponentially with time; Variational Bayes (VB) techniques have been applied to this problem. In this paper, we propose a new way of estimating variances based on online learning theory; we adapt expert aggregation methods to learn the variances over time. We apply the proposed method to synthetic data and to the problem of electricity load forecasting. We show that this method is robust to misspecification and outperforms traditional expert aggregation.
Machine Learning,Probability
What problem does this paper attempt to address?
This paper investigates the problem of handling environmental changes in time series forecasting, particularly for electricity load prediction. Traditional linear Gaussian state space models assume constant noise variance, but many real-world processes do not behave this way. The paper proposes a new approach that estimates the time-varying variance using online learning theory and treats the switching Kalman filter as an expert aggregation problem. This approach is robust to model misspecification and outperforms traditional expert aggregation methods in experiments. The paper also introduces algorithm implementation and performance analysis, demonstrating the effectiveness of the new framework in dealing with complex dynamic systems in the real world.