Abstract:The temporal knowledge graph builds upon the static knowledge graph by introducing the time dimension and finds extensive applications in real artificial intelligence scenarios. However, the temporal knowledge graph's incompleteness restricts the applicability of numerous temporal knowledge graph tasks. Temporal knowledge graph embedding (TKGE) is a representation learning technique that effectively addresses the temporal knowledge graph's incompleteness. These methods aim to map entities and relations in the knowledge graph to a low-dimensional vector space while capturing features over time. However, the current TKGE methods encounter three main challenges: (1) how to resolve the continuity problem of dynamic features in the continuous time domain; (2) how to simultaneously model the dependence of structural knowledge representation on time and dimension; (3) how to address the heterogeneity of time representation in a temporal knowledge graph. We propose the CDRGN-SDE, a C ross- D imensional R ecurrent G raph N etwork with a neural S tochastic D ifferential E quation framework, to tackle these challenges. The CDRGN-SDE model effectively addresses the above challenges and establishes a unified framework: (1) we employ a neural ordinary differential equation with stochastic noise to simulate the continuity of dynamic systems in the continuous time domain; (2) we propose a Dimension-Segment-Wise (DSW) embedding method for TKGE, which effectively integrates time and dimensional information; (3) we introduce a simple and effective time representation method that integrates complex time features into the model. Experimental evaluations on benchmark datasets demonstrate that the CDRGN-SDE model outperforms the state-of-the-art temporal knowledge graph reasoning models.

Dirichlet Graph Convolution Coupled Neural Differential Equation for Spatio-temporal Time Series Prediction

STONet: A Neural-Operator-Driven Spatio-temporal Network

Link prediction by continuous spatiotemporal representation via neural differential equations

Multivariate Time Series Forecasting with Dynamic Graph Neural ODEs

Parallel Multi-Scale Dynamic Graph Neural Network for Multivariate Time Series Forecasting

Dynamic Spatio-Temporal Graph Network with Adaptive Propagation Mechanism for Multivariate Time Series Forecasting

Newton-Cotes Graph Neural Networks: on the Time Evolution of Dynamic Systems

TVGCN: Time-varying graph convolutional networks for multivariate and multifeature spatiotemporal series prediction

On The Temporal Domain of Differential Equation Inspired Graph Neural Networks

Multivariate sequence prediction for graph convolutional networks based on ESMD and transfer entropy

Time-aware Personalized Graph Convolutional Network for Multivariate Time Series Forecasting

Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks

Dynamic Multi-Scale Spatio-Temporal Graph ODE for Metro Ridership Prediction

Dynamic Spatial-Temporal Embedding Via Neural Conditional Random Field for Multivariate Time Series Forecasting

Dynamic Personalized Graph Neural Network with Linear Complexity for Multivariate Time Series Forecasting

Spatial-temporal Graph Convolutional Networks with Diversified Transformation for Dynamic Graph Representation Learning

TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting

CDRGN-SDE: Cross-Dimensional Recurrent Graph Network with neural Stochastic Differential Equation for temporal knowledge graph embedding

It is all Connected: A New Graph Formulation for Spatio-Temporal Forecasting

Correlational graph attention-based Long Short-Term Memory network for multivariate time series prediction

Spatio-temporal graph neural network for time series prediction