Abstract:Transformer-based models demonstrate tremendous potential for Multivariate Time Series (MTS) forecasting due to their ability to capture long-term temporal dependencies by using the self-attention mechanism. However, effectively modeling the spatial correlation cross series for MTS is a challenge for Transformer. Although Graph Neural Networks (GNN) are competent for modeling spatial dependencies across series, existing methods are based on the assumption of static relationships between variables, which do not align with the time-varying spatial dependencies in real-world series. Therefore, we propose DyGraphformer, which integrates graph convolution into Transformer to assist Transformer in effectively modeling spatial dependencies, while also dynamically inferring time-varying spatial dependencies by combining historical spatial information. In DyGraphformer, decoder module involving complex recursion is abandoned to accelerate model execution. First, the input is embedded using DSW (Dimension Segment Wise) through integrating its position and node level embedding to preserve temporal and spatial information. Then, the time self-attention layer and dynamic graph convolutional layer are constructed to capture temporal dependencies and spatial dependencies of multivariate time series, respectively. The dynamic graph convolutional layer utilizes Gated Recurrent Unit (GRU) to obtain historical spatial dependencies, and integrates the series features of the current time to perform graph structure inference in multiple subspaces. Specifically, to fully utilize the spatio-temporal information at different scales, DyGraphformer performs hierarchical encoder learning for the final forecasting. Extensive experimental results on seven real-world datasets demonstrate DyGraphformer outperforms state-of-the-art baseline methods, with comparisons including Transformer-based and GNN-based methods.

Non-stationary GNNCrossformer: Transformer with Graph Information for Non-Stationary Multivariate Spatio-Temporal Wind Power Data Forecasting

Interpretable multi-graph convolution network integrating spatio-temporal attention and dynamic combination for wind power forecasting

Short-Term Forecasting Based on Graph Convolution Networks and Multiresolution Convolution Neural Networks for Wind Power

Wind Power Forecasting Based on a Spatial–Temporal Graph Convolution Network With Limited Engineering Knowledge

Multi-step short-term wind power prediction based on spatio-temporal graph convolutional networks

A short-term wind power prediction method via self-adaptive adjacency matrix and spatiotemporal graph neural networks

A robust spatio‐temporal prediction approach for wind power generation based on spectral temporal graph neural network

GAOformer: An adaptive spatiotemporal feature fusion transformer utilizing GAT and optimizable graph matrixes for offshore wind speed prediction

On the Use of Spatial-temporal Feature Graph Convolutional Network for Ultra-Short Term Prediction of Wind Power Generation

Multi-Wind Turbine Wind Speed Prediction Based on Weighted Diffusion Graph Convolution and Gated Attention Network

Spatial-Temporal Wind Power Probabilistic Forecasting Based on Time-Aware Graph Convolutional Network

DyGraphformer: Transformer combining dynamic spatio-temporal graph network for multivariate time series forecasting

Interpretable Wind Power Short-Term Power Prediction Model Using Deep Graph Attention Network

Very short-term spatial and temporal wind power forecasting: A deep learning approach

A Novel Wind Power Prediction Model That Considers Multi-Scale Variable Relationships and Temporal Dependencies

Augmented Convolutional Network for Wind Power Prediction: A New Recurrent Architecture Design With Spatial-Temporal Image Inputs

A Spatiotemporal Directed Graph Convolution Network for Ultra-Short-Term Wind Power Prediction

Long-term Wind Power Forecasting with Hierarchical Spatial-Temporal Transformer

Short-Term Wind Power Prediction via Spatial Temporal Analysis and Deep Residual Networks

M2GSNet: Multi-Modal Multi-Task Graph Spatiotemporal Network for Ultra-Short-Term Wind Farm Cluster Power Prediction

A multi-factor driven spatiotemporal wind power prediction model based on ensemble deep graph attention reinforcement learning networks