Multi-output Ensembles for Multi-step Forecasting

Vitor Cerqueira,Luis Torgo
2023-06-26
Abstract:This paper studies the application of ensembles composed of multi-output models for multi-step ahead forecasting problems. Dynamic ensembles have been commonly used for forecasting. However, these are typically designed for one-step-ahead tasks. On the other hand, the literature regarding the application of dynamic ensembles for multi-step ahead forecasting is scarce. Moreover, it is not clear how the combination rule is applied across the forecasting horizon. We carried out extensive experiments to analyze the application of dynamic ensembles for multi-step forecasting. We resorted to a case study with 3568 time series and an ensemble of 30 multi-output models. We discovered that dynamic ensembles based on arbitrating and windowing present the best performance according to average rank. Moreover, as the horizon increases, most approaches struggle to outperform a static ensemble that assigns equal weights to all models. The experiments are publicly available in a repository.
Machine Learning
What problem does this paper attempt to address?
The problems that this paper attempts to solve are the effectiveness and applicability of applying dynamic integration methods in multi - step prediction tasks. Specifically, the paper focuses on how to apply the dynamic integration composed of multi - output models to multi - step prediction problems and analyze the performance of different dynamic combination rules in multi - step prediction. In addition, the paper also explores the best method for calculating integration weights within the prediction time range. These problems are of great significance for improving the accuracy of multi - step prediction, especially in the case of non - stationary time - series data. The paper studies these methods through extensive experiments, using a data set containing 3,568 time series and an integration composed of 30 multi - output models.