Learning evolving relations for multivariate time series forecasting

Binh Nguyen-Thai,Vuong Le,Ngoc-Dung T. Tieu,Truyen Tran,Svetha Venkatesh,Naeem Ramzan
DOI: https://doi.org/10.1007/s10489-023-05220-0
IF: 5.3
2024-03-16
Applied Intelligence
Abstract:Multivariate time series forecasting is essential in various fields, including healthcare and traffic management, but it is a challenging task due to the strong dynamics in both intra-channel relations (temporal patterns within individual variables) and inter-channel relations (the relationships between variables), which can evolve over time with abrupt changes. This paper proposes ERAN (Evolving Relational Attention Network), a framework for multivariate time series forecasting, that is capable to capture such dynamics of these relations. On the one hand, ERAN represents inter-channel relations with a graph which evolves over time, modeled using a recurrent neural network. On the other hand, ERAN represents the intra-channel relations using a temporal attentional convolution, which captures the local temporal dependencies adaptively with the input data. The elvoving graph structure and the temporal attentional convolution are intergrated in a unified model to capture both types of relations. The model is experimented on a large number of real-life datasets including traffic flows, energy consumption, and COVID-19 transmission data. The experimental results show a significant improvement over the state-of-the-art methods in multivariate time series forecasting particularly for non-stationary data.
computer science, artificial intelligence
What problem does this paper attempt to address?
The paper aims to address the challenging problem of multivariate time series forecasting, particularly how to capture the dynamic changes in inter-channel relations and intra-channel relations. Specifically, the paper proposes the ERAN (Evolving Relational Attention Network) framework to handle multivariate time series forecasting tasks and effectively capture these relationships over time. The main innovations of ERAN include: 1. **Dynamic Graph Structure**: Capturing the dynamic relationships between variables by learning the graph structure at each time step, rather than using a static graph. 2. **Temporal Attentional Convolution (TAC)**: A self-attention mechanism used to capture the local temporal dependencies of intra-channel relations. 3. **Unified Model**: Integrating the dynamic graph structure and temporal attentional convolution into a unified framework to simultaneously capture both types of relationships. 4. **Experimental Validation**: Extensive experiments conducted on multiple real-world datasets, including traffic flow, energy consumption, and COVID-19 spread data, demonstrate that ERAN significantly outperforms existing methods in non-stationary time series forecasting.