HiFNet: rethinking time series forecasting models from a perspective of error power spectrum

Changsheng Zhu,Peiwen Yuan
DOI: https://doi.org/10.21203/rs.3.rs-3486334/v1
2023-01-01
Abstract:Abstract In recent years, simple models for time series forecasting task have attracted considerable attention from researchers. Recent works have revealed that a simple linear mapping is even more competitive in forecasting tasks than some well-designed models; meanwhile, MLPs can outperform linear models on datasets with a large number of channels. However, it remains unclear what the key difference is between these two architectures. In this paper, we explore the difference between linear models and MLPs from a novel perspective of error power spectrum. We analyze the inter-model and intra-training comparisons of error power spectrum and note that: 1) the error power at all frequencies is not uniformly distributed and different models have different error power spectral bias; 2) the error power at different frequencies does not necesarily converge at an equal rate. And based on these key observations, we propose a time series forecasting model called HiFNet, which stands for High-Frequency enhanced Network, and a model-agnostic ensemble learning approach called Frequency Ensemble. We conduct several experiments on different datasets and validate the effectiveness of our approaches.
What problem does this paper attempt to address?