A Causal Stacking Hidden Markov Model for Time Series Forecasting

Hui Niu,Xinheng Li,Jian Li
DOI: https://doi.org/10.1109/ijcnn60899.2024.10650850
2024-01-01
Abstract:Time series forecasting is one of the most important procedures within various real-world machine learning applications. However, the complexity and non-stationary nature of many realistic time series data challenges people to make reliable predictions. In this paper, we propose a novel Causal Stacking Hidden Markov model termed CASH to make reliable predictions while mining effective hidden states. CASH leverages structural invariances of causal inference and efficient hidden state uncovering capability of the Hidden Markov Model (HMM). It attributes time series signal movements to short-term, medium-term, and long-term factors, taking into account all three by stacking HMMs in-depth and enhanced by an attention mechanism. Subsequently, utilizing a reformulated sequential variational auto-encoder objective function, CASH learns effective hidden states in an unsupervised manner. For the final prediction, the hidden states are processed in a temporal attention layer to leverage labels. Comprehensive experiments on three realistic financial datasets and twenty multivariate time series classification datasets demonstrate the proposed CASH outperforms the state-of-the-art benchmarks on most datasets.
What problem does this paper attempt to address?