Abstract:Graph neural networks (GNNs), especially dynamic GNNs, have become a research hotspot in spatiotemporal forecasting problems. While many dynamic graph construction methods have been developed, relatively few of them explore the causal relationship between neighbor nodes. Thus, the resulting models lack strong explainability for the causal relationship between the neighbor nodes of the dynamically generated graphs, which can easily lead to a risk in subsequent decisions. Moreover, few of them consider the uncertainty and noise of dynamic graphs based on the time series datasets, which are ubiquitous in real-world graph structure networks. In this article, we propose a novel dynamic diffusion-variational GNN (DVGNN) for spatiotemporal forecasting. For dynamic graph construction, an unsupervised generative model is devised. Two layers of graph convolutional network (GCN) are applied to calculate the posterior distribution of the latent node embeddings in the encoder stage. Then, a diffusion model is used to infer the dynamic link probability and reconstruct causal graphs (CGs) in the decoder stage adaptively. The new loss function is derived theoretically, and the reparameterization trick is adopted in estimating the probability distribution of the dynamic graphs by evidence lower bound (ELBO) during the backpropagation period. After obtaining the generated graphs, dynamic GCN and temporal attention are applied to predict future states. Experiments are conducted on four real-world datasets of different graph structures in different domains. The results demonstrate that the proposed DVGNN model outperforms state-of-the-art approaches and achieves outstanding root mean square error (RMSE) results while exhibiting higher robustness. Also, by F1-score and probability distribution analysis, we demonstrate that DVGNN better reflects the causal relationship and uncertainty of dynamic graphs. The website of the code is https://github.com/gorgen2020/DVGNN.

Deep Evidential Learning in Diffusion Convolutional Recurrent Neural Network

Deep-Ensemble-Based Uncertainty Quantification in Spatiotemporal Graph Neural Networks for Traffic Forecasting

Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting

Graph Neural Stochastic Diffusion for Estimating Uncertainty in Node Classification

Dynamic Causal Explanation Based Diffusion-Variational Graph Neural Network for Spatio-temporal Forecasting

Dynamic Causal Explanation Based Diffusion-Variational Graph Neural Network for Spatiotemporal Forecasting

Variational graph neural network with diffusion prior for link prediction

GDCRN: Global Diffusion Convolutional Residual Network for Traffic Flow Prediction.

Unveiling Delay Effects in Traffic Forecasting: A Perspective from Spatial-Temporal Delay Differential Equations

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

A Comprehensive Survey on Evidential Deep Learning and Its Applications

Learning Diffusions under Uncertainty

Diffusion Improves Graph Learning

DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models

Spatial dynamic graph convolutional network for traffic flow forecasting

Incorporating Domain Differential Equations into Graph Convolutional Networks to Lower Generalization Discrepancy

SAGDFN: A Scalable Adaptive Graph Diffusion Forecasting Network for Multivariate Time Series Forecasting

Towards Unifying Diffusion Models for Probabilistic Spatio-Temporal Graph Learning

Transfer Learning with Graph Neural Networks for Short-Term Highway Traffic Forecasting

Flexible Graph Neural Diffusion with Latent Class Representation Learning

Evidential Deep Learning for Probabilistic Modelling of Extreme Storm Events