Abstract:Accurate prediction of future events brings great benefits and reduces losses for society in many domains, such as civil unrest, pandemics, and crimes. Knowledge graph is a general language for describing and modeling complex systems. Different types of events continually occur, which are often related to historical and concurrent events. In this paper, we formalize the future event prediction as a temporal knowledge graph reasoning problem. Most existing studies either conduct reasoning on static knowledge graphs or assume knowledges graphs of all timestamps are available during the training process. As a result, they cannot effectively reason over temporal knowledge graphs and predict events happening in the future. To address this problem, some recent works learn to infer future events based on historical event-based temporal knowledge graphs. However, these methods do not comprehensively consider the latent patterns and influences behind historical events and concurrent events simultaneously. This paper proposes a new graph representation learning model, namely Recurrent Event Graph ATtention Network (RE-GAT), based on a novel historical and concurrent events attention-aware mechanism by modeling the event knowledge graph sequence recurrently. More specifically, our RE-GAT uses an attention-based historical events embedding module to encode past events, and employs an attention-based concurrent events embedding module to model the associations of events at the same timestamp. A translation-based decoder module and a learning objective are developed to optimize the embeddings of entities and relations. We evaluate our proposed method on four benchmark datasets. Extensive experimental results demonstrate the superiority of our RE-GAT model comparing to various baselines, which proves that our method can more accurately predict what events are going to happen.

Integrating Hierarchical Attentions for Future Subevent Prediction

What Happens Next? Future Subevent Prediction Using Contextual Hierarchical LSTM.

A neural model for joint event detection and prediction

SPAN: Subgraph Prediction Attention Network for Dynamic Graphs

Hierarchical Attention based Feature Learning for Interpretable Social Event Prediction.

DRAM: A Deep Reinforced Intra-attentive Model for Event Prediction.

A Temporal Attention-based Model for Social Event Prediction

An Improved Hierarchical Neural Network Model with Local and Global Feature Matching for Script Event Prediction

Hierarchical Attention Neural Network for Event Types to Improve Event Detection.

A Multi-Hierarchical Attention-Based Prediction Method on Time Series with Spatio-Temporal Context among Variables

Enhancing spatiotemporal predictive learning: an approach with nested attention module

Social Emotion Prediction with Attention-based Hierarchical Neural Network

Modeling Dynamic Heterogeneous Network for Link Prediction using Hierarchical Attention with Temporal RNN

Integrating Argument-Level Attention with Multi-Level Scores to Predict What Happen Next

Future Event Prediction Based on Temporal Knowledge Graph Embedding.

Dynamic Hierarchical Attention Network for News Recommendation

Hierarchical Time Series Forecasting Based on Temporal Convolution and Attention Mechanism

MM-Pred: A Deep Predictive Model for Multi-attribute Event Sequence

HSTA: A Hierarchical Spatio-Temporal Attention Model for Trajectory Prediction

Hierarchical Neural Networks for Multivariate Time Series Prediction

Hierarchical Self-Attention Embedding for Temporal Knowledge Graph Completion.