Abstract:Transformer-based models demonstrate tremendous potential for Multivariate Time Series (MTS) forecasting due to their ability to capture long-term temporal dependencies by using the self-attention mechanism. However, effectively modeling the spatial correlation cross series for MTS is a challenge for Transformer. Although Graph Neural Networks (GNN) are competent for modeling spatial dependencies across series, existing methods are based on the assumption of static relationships between variables, which do not align with the time-varying spatial dependencies in real-world series. Therefore, we propose DyGraphformer, which integrates graph convolution into Transformer to assist Transformer in effectively modeling spatial dependencies, while also dynamically inferring time-varying spatial dependencies by combining historical spatial information. In DyGraphformer, decoder module involving complex recursion is abandoned to accelerate model execution. First, the input is embedded using DSW (Dimension Segment Wise) through integrating its position and node level embedding to preserve temporal and spatial information. Then, the time self-attention layer and dynamic graph convolutional layer are constructed to capture temporal dependencies and spatial dependencies of multivariate time series, respectively. The dynamic graph convolutional layer utilizes Gated Recurrent Unit (GRU) to obtain historical spatial dependencies, and integrates the series features of the current time to perform graph structure inference in multiple subspaces. Specifically, to fully utilize the spatio-temporal information at different scales, DyGraphformer performs hierarchical encoder learning for the final forecasting. Extensive experimental results on seven real-world datasets demonstrate DyGraphformer outperforms state-of-the-art baseline methods, with comparisons including Transformer-based and GNN-based methods.

TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting

Parallel Multi-Scale Dynamic Graph Neural Network for Multivariate Time Series Forecasting

Time-Decay Dynamic Graph Neural Network for Multivariate Time Series Forecasting

Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting

Multivariate Time Series Forecasting exploiting Tensor Projection Embedding and Gated Memory Network

MTHetGNN: A Heterogeneous Graph Embedding Framework for Multivariate Time Series Forecasting

Learning Dynamic Temporal Relations with Continuous Graph for Multivariate Time Series Forecasting (student Abstract).

Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks

Dynamic Graph Structure Learning for Multivariate Time Series Forecasting

Multivariate Time Series Forecasting with Dynamic Graph Neural ODEs

DyGraphformer: Transformer combining dynamic spatio-temporal graph network for multivariate time series forecasting

Multivariate long sequence time-series forecasting using dynamic graph learning

Time-aware Personalized Graph Convolutional Network for Multivariate Time Series Forecasting

FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph Perspective

Multiple Time Series Forecasting with Dynamic Graph Modeling

A Decomposition-Based Memetic Neural Architecture Search Algorithm for Univariate Time Series Forecasting.

Learning and Integration of Adaptive Hybrid Graph Structures for Multivariate Time Series Forecasting.

Multi-channel Fusion Graph Neural Network for Multivariate Time Series Forecasting.

Learning the Evolutionary and Multi-scale Graph Structure for Multivariate Time Series Forecasting

TodyNet: Temporal Dynamic Graph Neural Network for Multivariate Time Series Classification

MDG: A Multi-Task Dynamic Graph Generation Framework for Multivariate Time Series Forecasting