Abstract:Temporal knowledge graph (TKG) representation learning aims to project entities and relations in TKGs to a low-dimensional vector space while preserving the evolutionary nature of TKGs. Most existing methods treat knowledge that happens at different times separately, which fails to explore how temporal knowledge graphs evolve over time. Actually, TKGs should evolve both on the local and global structures. The local structure evolution describes the formation process of the graph structure in a detailed manner, while the global structure evolution refers to the dynamic topology (e.g., community partition) of the graph, which is derived from the continuous formation process. Both are key factors for understanding the evolutionary nature of the TKGs. Unfortunately, little attention has been given to this area of research. In this paper, we propose a new TKG representation learning framework with local and global structure evolutions, named EvoExplore. Specifically, we define the local structure evolution as an establishment process of the relations between the entities, and propose a hierarchical-attention-based temporal point process to capture the formation process of the graph structure in a fine-grained manner. For global structure evolution, we propose a novel soft modularity parameterized by the entity representations to capture the dynamic community partition of the TKGs. Finally, we employ a multi-task loss function to jointly optimize the above two parts, which allows EvoExplore to learn the mutual influences of the local and global structure evolutions. Experimental results on three real-world datasets demonstrate the superiority of EvoExplore compared with the baseline methods. Code is available at https://github.com/zjs123/EvoExplore and https://github.com/zjs123/EvoExplore_MindSpore.

Language Models-enhanced Semantic Topology Representation Learning for Temporal Knowledge Graph Extrapolation

Learning Multi-graph Structure for Temporal Knowledge Graph Reasoning

Meta-Learning Based Knowledge Extrapolation for Temporal Knowledge Graph

Temporal knowledge graph reasoning triggered by memories

Learning Long- and Short-term Representations for Temporal Knowledge Graph Reasoning

zrLLM: Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Models

Time-aware Graph Structure Learning Via Sequence Prediction on Temporal Graphs.

Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning

Temporal Knowledge Graph Reasoning Based on Evolutional Representation and Contrastive Learning

Chain of History: Learning and Forecasting with LLMs for Temporal Knowledge Graph Completion

TPmod: A Tendency-Guided Prediction Model for Temporal Knowledge Graph Completion

GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Models

Chain-of-History Reasoning for Temporal Knowledge Graph Forecasting

MetaTKG: Learning Evolutionary Meta-Knowledge for Temporal Knowledge Graph Reasoning

Local-Global History-aware Contrastive Learning for Temporal Knowledge Graph Reasoning

Logic and Commonsense-Guided Temporal Knowledge Graph Completion

Pre-trained Language Model with Prompts for Temporal Knowledge Graph Completion

Temporal knowledge graph representation learning with local and global evolutions

A Unified Temporal Knowledge Graph Reasoning Model Towards Interpolation and Extrapolation