Abstract:Extrapolating future events based on historical information in temporal knowledge graphs (TKGs) holds significant research value and practical applications. In this field, the methods currently utilized can be classified as either embedding-based or logical rule-based. Embedding-based methods depend on learned entity and relation embeddings for prediction, but they suffer from the lack of interpretability due to the opaque reasoning process. On the other hand, logical rule-based methods face scalability challenges as they heavily rely on predefined logical rules. To overcome these limitations, we propose a hybrid model that combines embedding-based and logical rule-based methods to capture deep causal logic. Our model, called the Inductive Reasoning Model based on Interpretable Logical Rule (ILR-IR), aims to provide interpretable insights while effectively predicting future events in TKGs. ILR-IR delves into historical information, extracting valuable insights from logical rules embedded within relations and interaction preferences between entities. By considering both logical rules and interaction preferences, ILR-IR offers a comprehensive perspective for predicting future events. In addition, we propose the incorporation of a one-class augmented matching loss during optimization, which serves to enhance performance of the model during training. We evaluate ILR-IR on multiple datasets, including ICEWS14, ICEWS0515, and ICEWS18. Experimental results demonstrate that ILR-IR outperforms state-of-the-art baselines, showcasing its superior performance in TKG extrapolation reasoning. Moreover, ILR-IR demonstrates remarkable generalization capabilities, even when applied to related datasets that share a common relation vocabulary. This suggests that our proposed model exhibits robust zero-shot reasoning abilities. For interested parties, we have made our code publicly available at https://github.com/mxadorable/ILR-IR .

MIRAGE: Evaluating and Explaining Inductive Reasoning Process in Language Models

Concise and Organized Perception Facilitates Large Language Models for Deductive Reasoning.

Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement

The Role of Deductive and Inductive Reasoning in Large Language Models

Hypothesis Search: Inductive Reasoning with Language Models

Inductive or Deductive? Rethinking the Fundamental Reasoning Abilities of LLMs

Language Models as Inductive Reasoners

LLMs for Relational Reasoning: How Far are We?

Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models

IDEA: Enhancing the Rule Learning Ability of Large Language Model Agent through Induction, Deduction, and Abduction

Mars: Situated Inductive Reasoning in an Open-World Environment

Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond

InfiMM-Eval: Complex Open-Ended Reasoning Evaluation For Multi-Modal Large Language Models

Eliminating Reasoning via Inferring with Planning: A New Framework to Guide LLMs' Non-linear Thinking

Mirror: A Multiple-perspective Self-Reflection Method for Knowledge-rich Reasoning

Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models

An Inductive Reasoning Model based on Interpretable Logical Rules over temporal knowledge graph

How Far Are We from Intelligent Visual Deductive Reasoning?

LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models

Comparing Inferential Strategies of Humans and Large Language Models in Deductive Reasoning

Enhancing Large Language Models Against Inductive Instructions with Dual-critique Prompting