Learning Event Graph Knowledge for Abductive Reasoning

Li Du,Xiao Ding,Ting Liu,Bing Qin

DOI: https://doi.org/10.18653/v1/2021.acl-long.403

2021-01-01

Abstract:Li Du, Xiao Ding, Ting Liu, Bing Qin. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.

What problem does this paper attempt to address?

Enabling Abductive Learning to Exploit Knowledge Graph

Yu-Xuan Huang,Zequn Sun,Guangyao Li,Xiaobin Tian,Wang-Zhou Dai,Wei Hu,Yuan Jiang,Zhi-Hua Zhou

DOI: https://doi.org/10.24963/ijcai.2023/427

2023-01-01

Abstract:Most systems integrating data-driven machine learning with knowledge-driven reasoning usually rely on a specifically designed knowledge base to enable efficient symbolic inference. However, it could be cumbersome for the nonexpert end-users to prepare such a knowledge base in real tasks. Recent years have witnessed the success of large-scale knowledge graphs, which could be ideal domain knowledge resources for real-world machine learning tasks. However, these large-scale knowledge graphs usually contain much information that is irrelevant to a specific learning task. Moreover, they often contain a certain degree of noise. Existing methods can hardly make use of them because the large-scale probabilistic logical inference is usually intractable. To address these problems, we present ABductive Learning with Knowledge Graph (ABL-KG) that can automatically mine logic rules from knowledge graphs during learning, using a knowledge forgetting mechanism for filtering out irrelevant information. Meanwhile, these rules can form a logic program that enables efficient joint optimization of the machine learning model and logic inference within the Abductive Learning (ABL) framework. Experiments on four different tasks show that ABL-KG can automatically extract useful rules from large-scale and noisy knowledge graphs, and significantly improve the performance of machine learning with only a handful of labeled data.
Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation

Jiaxin Bai,Yicheng Wang,Tianshi Zheng,Yue Guo,Xin Liu,Yangqiu Song

2024-06-20

Abstract:Abductive reasoning is the process of making educated guesses to provide explanations for observations. Although many applications require the use of knowledge for explanations, the utilization of abductive reasoning in conjunction with structured knowledge, such as a knowledge graph, remains largely unexplored. To fill this gap, this paper introduces the task of complex logical hypothesis generation, as an initial step towards abductive logical reasoning with KG. In this task, we aim to generate a complex logical hypothesis so that it can explain a set of observations. We find that the supervised trained generative model can generate logical hypotheses that are structurally closer to the reference hypothesis. However, when generalized to unseen observations, this training objective does not guarantee better hypothesis generation. To address this, we introduce the Reinforcement Learning from Knowledge Graph (RLF-KG) method, which minimizes differences between observations and conclusions drawn from generated hypotheses according to the KG. Experiments show that, with RLF-KG's assistance, the generated hypotheses provide better explanations, and achieve state-of-the-art results on three widely used KGs.

Artificial Intelligence,Computation and Language
Neural Probabilistic Logic Learning for Knowledge Graph Reasoning

Fengsong Sun,Jinyu Wang,Zhiqing Wei,Xianchao Zhang

2024-07-04

Abstract:Knowledge graph (KG) reasoning is a task that aims to predict unknown facts based on known factual samples. Reasoning methods can be divided into two categories: rule-based methods and KG-embedding based methods. The former possesses precise reasoning capabilities but finds it challenging to reason efficiently over large-scale knowledge graphs. While gaining the ability to reason over large-scale knowledge graphs, the latter sacrifices reasoning accuracy. This paper aims to design a reasoning framework called Neural Probabilistic Logic Learning(NPLL) that achieves accurate reasoning on knowledge graphs. Our approach introduces a scoring module that effectively enhances the expressive power of embedding networks, striking a balance between model simplicity and reasoning capabilities. We improve the interpretability of the model by incorporating a Markov Logic Network based on variational inference. We empirically evaluate our approach on several benchmark datasets, and the experimental results validate that our method substantially enhances the accuracy and quality of the reasoning results.

Artificial Intelligence,Machine Learning
Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoning

Wen Zhang,Bibek Paudel,Liang Wang,Jiaoyan Chen,Hai Zhu,Wei Zhang,Abraham Bernstein,Huajun Chen

DOI: https://doi.org/10.48550/arxiv.1903.08948

2019-01-01

Abstract:Reasoning is essential for the development of large knowledge graphs, especially for completion, which aims to infer new triples based on existing ones. Both rules and embeddings can be used for knowledge graph reasoning and they have their own advantages and difficulties. Rule-based reasoning is accurate and explainable but rule learning with searching over the graph always suffers from efficiency due to huge search space. Embedding-based reasoning is more scalable and efficient as the reasoning is conducted via computation between embeddings, but it has difficulty learning good representations for sparse entities because a good embedding relies heavily on data richness. Based on this observation, in this paper we explore how embedding and rule learning can be combined together and complement each other's difficulties with their advantages. We propose a novel framework IterE iteratively learning embeddings and rules, in which rules are learned from embeddings with proper pruning strategy and embeddings are learned from existing triples and new triples inferred by rules. Evaluations on embedding qualities of IterE show that rules help improve the quality of sparse entity embeddings and their link prediction results. We also evaluate the efficiency of rule learning and quality of rules from IterE compared with AMIE+, showing that IterE is capable of generating high quality rules more efficiently. Experiments show that iteratively learning embeddings and rules benefit each other during learning and prediction.
Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspective

Wen Zhang,Jiaoyan Chen,Juan Li,Zezhong Xu,Jeff Z. Pan,Huajun Chen

DOI: https://doi.org/10.48550/arxiv.2202.07412

2022-01-01

Abstract: Knowledge graph (KG) reasoning is becoming increasingly popular in both academia and industry. Conventional KG reasoning based on symbolic logic is deterministic, with reasoning results being explainable, while modern embedding-based reasoning can deal with uncertainty and predict plausible knowledge, often with high efficiency via vector computation. A promising direction is to integrate both logic-based and embedding-based methods, with the vision to have advantages of both. It has attracted wide research attention with more and more works published in recent years. In this paper, we comprehensively survey these works, focusing on how logics and embeddings are integrated. We first briefly introduce preliminaries, then systematically categorize and discuss works of logic and embedding-aware KG reasoning from different perspectives, and finally conclude and discuss the challenges and further directions.
Modeling Event-Pair Relations in External Knowledge Graphs for Script Reasoning.

Yucheng Zhou,Xiubo Geng,Tao Shen,Jian Pei,Wenqiang Zhang,Daxin Jiang

DOI: https://doi.org/10.18653/v1/2021.findings-acl.403

2021-01-01

Abstract:Script reasoning infers subsequent events from a given event chain, which involves the ability to understand relations between events. A human-labeled script reasoning dataset is usually of small size with limited event relations, which highlights the necessity to leverage external eventuality knowledge graphs (KG) consisting of numerous triple facts to describe the inferential relation between events. Existing methods adopt a retrieval and integration paradigm to focus merely on the graph triples that have event overlap with a script, but ignore much more supportive triples in the KG with similar inferential patterns, leading to underexploiting. To fully exploit the KG, we propose a knowledge model to learn the inferential relations between events from the whole eventuality KG and then support downstream models by directly capturing the relation between events in a script. We further present a neural script adapter to extend the knowledge model for inferring the associated relations between an event chain and a subsequent event candidate. We evaluate the proposed approach on a popular multi-choice narrative cloze task for script reasoning and achieve new state-ofthe-art accuracy, compared with baselines either incorporating external KG or not.
Abductive Learning with Ground Knowledge Base.

Le-Wen Cai,Wang-Zhou Dai,Yu-Xuan Huang,Yu-Feng Li,Stephen Muggleton,Yuan Jiang

DOI: https://doi.org/10.24963/ijcai.2021/250

2021-01-01

Abstract:Abductive Learning is a framework that combines machine learning with first-order logical reasoning. It allows machine learning models to exploit complex symbolic domain knowledge represented by first-order logic rules. However, it is challenging to obtain or express the ground-truth domain knowledge explicitly as first-order logic rules in many applications. The only accessible knowledge base is implicitly represented by groundings, i.e., propositions or atomic formulas without variables. This paper proposes Grounded Abductive Learning (GABL) to enhance machine learning models with abductive reasoning in a ground domain knowledge base, which offers inexact supervision through a set of logic propositions. We apply GABL on two weakly supervised learning problems and found that the model's initial accuracy plays a crucial role in learning. The results on a real-world OCR task show that GABL can significantly reduce the effort of data labeling than the compared methods.
Inductive Knowledge Graph Reasoning for Multi-batch Emerging Entities.

Yuanning Cui,Yuxin Wang,Zequn Sun,Wenqiang Liu,Yiqiao Jiang,Kexin Han,Wei Hu

DOI: https://doi.org/10.1145/3511808.3557361

2022-01-01

Abstract:Over the years, reasoning over knowledge graphs (KGs), which aims to infer new conclusions from known facts, has mostly focused on static KGs. The unceasing growth of knowledge in real life raises the necessity to enable the inductive reasoning ability on expanding KGs. Existing inductive work assumes that new entities all emerge once in a batch, which oversimplifies the real scenario that new entities continually appear. This study dives into a more realistic and challenging setting where new entities emerge in multiple batches. We propose a walk-based inductive reasoning model to tackle the new setting. Specifically, a graph convolutional network with adaptive relation aggregation is designed to encode and update entities using their neighboring relations. To capture the varying neighbor importance, we employ a query-aware feedback attention mechanism during the aggregation. Furthermore, to alleviate the sparse link problem of new entities, we propose a link augmentation strategy to add trustworthy facts into KGs. We construct three new datasets for simulating this multi-batch emergence scenario. The experimental results show that our proposed model outperforms state-of-the-art embedding-based, walk-based and rule-based models on inductive KG reasoning.
EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs

Cheng Jiayang,Lin Qiu,Chunkit Chan,Xin Liu,Yangqiu Song,Zheng Zhang

2024-07-07

Abstract:Narrative reasoning relies on the understanding of eventualities in story contexts, which requires a wealth of background world knowledge. To help machines leverage such knowledge, existing solutions can be categorized into two groups. Some focus on implicitly modeling eventuality knowledge by pretraining language models (LMs) with eventuality-aware objectives. However, this approach breaks down knowledge structures and lacks interpretability. Others explicitly collect world knowledge of eventualities into structured eventuality-centric knowledge graphs (KGs). However, existing research on leveraging these knowledge sources for free-texts is limited. In this work, we propose an initial comprehensive framework called EventGround, which aims to tackle the problem of grounding free-texts to eventuality-centric KGs for contextualized narrative reasoning. We identify two critical problems in this direction: the event representation and sparsity problems. We provide simple yet effective parsing and partial information extraction methods to tackle these problems. Experimental results demonstrate that our approach consistently outperforms baseline models when combined with graph neural network (GNN) or large language model (LLM) based graph reasoning models. Our framework, incorporating grounded knowledge, achieves state-of-the-art performance while providing interpretable evidence.

Computation and Language
Abductive Knowledge Induction From Raw Data

Wang-Zhou Dai,Stephen H. Muggleton

DOI: https://doi.org/10.48550/arXiv.2010.03514

2021-05-20

Abstract:For many reasoning-heavy tasks involving raw inputs, it is challenging to design an appropriate end-to-end learning pipeline. Neuro-Symbolic Learning, divide the process into sub-symbolic perception and symbolic reasoning, trying to utilise data-driven machine learning and knowledge-driven reasoning simultaneously. However, they suffer from the exponential computational complexity within the interface between these two components, where the sub-symbolic learning model lacks direct supervision, and the symbolic model lacks accurate input facts. Hence, most of them assume the existence of a strong symbolic knowledge base and only learn the perception model while avoiding a crucial problem: where does the knowledge come from? In this paper, we present Abductive Meta-Interpretive Learning ($Meta_{Abd}$) that unites abduction and induction to learn neural networks and induce logic theories jointly from raw data. Experimental results demonstrate that $Meta_{Abd}$ not only outperforms the compared systems in predictive accuracy and data efficiency but also induces logic programs that can be re-used as background knowledge in subsequent learning tasks. To the best of our knowledge, $Meta_{Abd}$ is the first system that can jointly learn neural networks from scratch and induce recursive first-order logic theories with predicate invention.

Artificial Intelligence,Machine Learning
LearnDA: Learnable Knowledge-Guided Data Augmentation for Event Causality Identification

Xinyu Zuo,Pengfei Cao,Yubo Chen,Kang Liu,Jun Zhao,Weihua Peng,Yuguang Chen

DOI: https://doi.org/10.48550/arXiv.2106.01649

2021-06-03

Abstract:Modern models for event causality identification (ECI) are mainly based on supervised learning, which are prone to the data lacking problem. Unfortunately, the existing NLP-related augmentation methods cannot directly produce the available data required for this task. To solve the data lacking problem, we introduce a new approach to augment training data for event causality identification, by iteratively generating new examples and classifying event causality in a dual learning framework. On the one hand, our approach is knowledge-guided, which can leverage existing knowledge bases to generate well-formed new sentences. On the other hand, our approach employs a dual mechanism, which is a learnable augmentation framework and can interactively adjust the generation process to generate task-related sentences. Experimental results on two benchmarks EventStoryLine and Causal-TimeBank show that 1) our method can augment suitable task-related training data for ECI; 2) our method outperforms previous methods on EventStoryLine and Causal-TimeBank (+2.5 and +2.1 points on F1 value respectively).

Computation and Language
ELG: An Event Logic Graph

Xiao Ding,Zhongyang Li,Ting Liu,Kuo Liao

DOI: https://doi.org/10.48550/arXiv.1907.08015

2019-08-08

Abstract:The evolution and development of events have their own basic principles, which make events happen sequentially. Therefore, the discovery of such evolutionary patterns among events are of great value for event prediction, decision-making and scenario design of dialog systems. However, conventional knowledge graph mainly focuses on the entities and their relations, which neglects the real world events. In this paper, we present a novel type of knowledge base - Event Logic Graph (ELG), which can reveal evolutionary patterns and development logics of real world events. Specifically, ELG is a directed cyclic graph, whose nodes are events, and edges stand for the sequential, causal, conditional or hypernym-hyponym (is-a) relations between events. We constructed two domain ELG: financial domain ELG, which consists of more than 1.5 million of event nodes and more than 1.8 million of directed edges, and travel domain ELG, which consists of about 30 thousand of event nodes and more than 234 thousand of directed edges. Experimental results show that ELG is effective for the task of script event prediction.

Artificial Intelligence,Computation and Language
LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities

Yuqi Zhu,Xiaohan Wang,Jing Chen,Shuofei Qiao,Yixin Ou,Yunzhi Yao,Shumin Deng,Huajun Chen,Ningyu Zhang

2024-08-18

Abstract:This paper presents an exhaustive quantitative and qualitative evaluation of Large Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We engage in experiments across eight diverse datasets, focusing on four representative tasks encompassing entity and relation extraction, event extraction, link prediction, and question-answering, thereby thoroughly exploring LLMs' performance in the domain of construction and inference. Empirically, our findings suggest that LLMs, represented by GPT-4, are more suited as inference assistants rather than few-shot information extractors. Specifically, while GPT-4 exhibits good performance in tasks related to KG construction, it excels further in reasoning tasks, surpassing fine-tuned models in certain cases. Moreover, our investigation extends to the potential generalization ability of LLMs for information extraction, leading to the proposition of a Virtual Knowledge Extraction task and the development of the corresponding VINE dataset. Based on these empirical findings, we further propose AutoKG, a multi-agent-based approach employing LLMs and external sources for KG construction and reasoning. We anticipate that this research can provide invaluable insights for future undertakings in the field of knowledge graphs. The code and datasets are in <a class="link-external link-https" href="https://github.com/zjunlp/AutoKG" rel="external noopener nofollow">this https URL</a>.

Computation and Language,Artificial Intelligence,Databases,Information Retrieval,Machine Learning
Learning and reasoning with graph data

Manfred Jaeger

DOI: https://doi.org/10.3389/frai.2023.1124718

2023-08-22

Abstract:Reasoning about graphs, and learning from graph data is a field of artificial intelligence that has recently received much attention in the machine learning areas of graph representation learning and graph neural networks. Graphs are also the underlying structures of interest in a wide range of more traditional fields ranging from logic-oriented knowledge representation and reasoning to graph kernels and statistical relational learning. In this review we outline a broad map and inventory of the field of learning and reasoning with graphs that spans the spectrum from reasoning in the form of logical deduction to learning node embeddings. To obtain a unified perspective on such a diverse landscape we introduce a simple and general semantic concept of a model that covers logic knowledge bases, graph neural networks, kernel support vector machines, and many other types of frameworks. Still at a high semantic level, we survey common strategies for model specification using probabilistic factorization and standard feature construction techniques. Based on this semantic foundation we introduce a taxonomy of reasoning tasks that casts problems ranging from transductive link prediction to asymptotic analysis of random graph models as queries of different complexities for a given model. Similarly, we express learning in different frameworks and settings in terms of a common statistical maximum likelihood principle. Overall, this review aims to provide a coherent conceptual framework that provides a basis for further theoretical analyses of respective strengths and limitations of different approaches to handling graph data, and that facilitates combination and integration of different modeling paradigms.
Overview of Knowledge Reasoning for Knowledge Graph

Xinliang Liu,Tingyu Mao,Yanyan Shi,Yanzhao Ren

DOI: https://doi.org/10.1016/j.neucom.2024.127571

IF: 6

2024-04-03

Neurocomputing

Abstract:Knowledge graphs are large-scale semantic networks that considerably impact knowledge representation. Mining hidden knowledge from existing data, including triplet knowledge reasoning, is a primary objective of knowledge graphs. With the development of Neural Network (NN) and Deep Learning (DL), the interpretability of triplet knowledge reasoning gradually decreases; furthermore, what machines learn is not actual reasoning but digital reasoning shortcuts. To solve this problem, more background knowledge needs to be introduced into knowledge graphs: causal graphs can offer valuable causal logic knowledge for reasoning; temporal quadruples can provide essential temporal distribution details; and commonsense graphs can furnish pertinent commonsense understanding to support reasoning. In recent years, many scholars have incorporated additional background knowledge into knowledge graphs to construct more complex reasoning mechanisms. This paper reviews the basic concepts and definitions of knowledge reasoning and the reasoning methods used for knowledge graphs. Specifically, we dissect the reasoning methods into four categories: triplet reasoning, causal inference, temporal inference, and commonsense reasoning. Finally, we discuss the remaining challenges and research opportunities related to knowledge graph reasoning.

computer science, artificial intelligence
Learning Abduction under Partial Observability

Brendan Juba,Zongyi Li,Evan Miller

DOI: https://doi.org/10.48550/arXiv.1711.04438

2017-11-25

Abstract:Juba recently proposed a formulation of learning abductive reasoning from examples, in which both the relative plausibility of various explanations, as well as which explanations are valid, are learned directly from data. The main shortcoming of this formulation of the task is that it assumes access to full-information (i.e., fully specified) examples; relatedly, it offers no role for declarative background knowledge, as such knowledge is rendered redundant in the abduction task by complete information. In this work, we extend the formulation to utilize such partially specified examples, along with declarative background knowledge about the missing data. We show that it is possible to use implicitly learned rules together with the explicitly given declarative knowledge to support hypotheses in the course of abduction. We observe that when a small explanation exists, it is possible to obtain a much-improved guarantee in the challenging exception-tolerant setting. Such small, human-understandable explanations are of particular interest for potential applications of the task.

Artificial Intelligence
International Workshop on Learning with Knowledge Graphs: Construction, Embedding, and Reasoning.

Qing Li,Xiao Huang,Ninghao Liu,Yuxiao Dong,Guansong Pang

DOI: https://doi.org/10.1145/3539597.3572705

2023-01-01

Abstract:A knowledge graph (KG) consists of numerous triples, in which each triple, i.e., (head entity, relation, tail entity), denotes a real-world assertion. Many large-scale KGs have been developed, e.g., general-purpose KGs Freebase and YAGO. Also, lots of domain-specific KGs are emerging, e.g., COVID-19 KGs, biomedical KGs, and agricultural KGs. By embedding KGs into low-dimensional vectors, i.e., representations of entities and relations, we could integrate KGs into machine learning models and enhance the performance of many prediction tasks, including search, recommendations, and question answering. During the construction, refinement, embedding, and application of KGs, a variety of KG learning algorithms have been developed to handle challenges in various real-world scenarios. Moreover, graph neural networks have also brought new opportunities to KG learning. This workshop aims to engage with active researchers from KG communities, recommendation communities, natural language processing communities, and other communities, and deliver state-of-the-art research insights into the core challenges in KG learning.
Approximate Ontology Reasoning for Domain-Specific Knowledge Graph based on Deep Learning

Xixi Zhu,Bin Liu,Zhaoyun Ding,Cheng Zhu,Li Yao

DOI: https://doi.org/10.1109/bigdia53151.2021.9619694

2021-10-29

Abstract:Ontology reasoning has great potential in application of domain-specific knowledge graph. However, the traditional ontology reasoner is difficult to perform rapidly reasoning on domain-specific knowledge graph as its complex logical expression and large-scale assertion set. On the other hand, the knowledge graph reasoning method based on presentation learning has better scalability, but it is hard to incorporate expert knowledge in the schema-level information effectively, so it can't implement complex reasoning. The above restricts the application of reasoning in domain-specific knowledge graph. In order to solve the problem, researchers try to combine ontology reasoning with deep learning to achieve approximate ontology reasoning. However, the state-of-the-art method has shortcomings of model design and evaluation which make it lose generalization ability. This paper proposes a novel method to transform ontology reasoning into a graph-to-graph relational mapping learning model, and realizes approximate ontology reasoning based on deep learning. Besides, this paper also defines new knowledge graph reasoning evaluation criterion, and synthesizes new test data. On this basis, relevant comparative experiments are carried out. The results show that the proposed method achieves good performance on LUBM synthetic dataset, even though the data mode that not appear in the training can also be inferred effectively, which can make the model applicable to a wider range of application scenarios.
Causal Reinforcement Learning for Knowledge Graph Reasoning

Jianping Wu,Yunjun Lu,Wenlu Zhou,Guangjun Zeng,Dezhi Li

DOI: https://doi.org/10.3390/app14062498

2024-03-15

Applied Sciences

Abstract:Knowledge graph reasoning can deduce new facts and relationships, which is an important research direction of knowledge graphs. Most of the existing methods are based on end-to-end reasoning which cannot effectively use the knowledge graph, so consequently the performance of the method still needs to be improved. Therefore, we combine causal inference with reinforcement learning and propose a new framework for knowledge graph reasoning. By combining the counterfactual method in causal inference, our method can obtain more information as prior knowledge and integrate it into the control strategy in the reinforcement model. The proposed method mainly includes the steps of relationship importance identification, reinforcement learning framework design, policy network design, and the training and testing of the causal reinforcement learning model. Specifically, a prior knowledge table is first constructed to indicate which relationship is more important for the problem to be queried; secondly, designing state space, optimization, action space, state transition and reward, respectively, is undertaken; then, the standard value is set and compared with the weight value of each candidate edge, and an action strategy is selected according to the comparison result through prior knowledge or neural network; finally, the parameters of the reinforcement learning model are determined through training and testing. We used four datasets to compare our method to the baseline method and conducted ablation experiments. On dataset NELL-995 and FB15k-237, the experimental results show that the MAP scores of our method are 87.8 and 45.2, and the optimal performance is achieved.

Computer Science
Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models

Jie Ma,Zhitao Gao,Qi Chai,Wangchun Sun,Pinghui Wang,Hongbin Pei,Jing Tao,Lingyun Song,Jun Liu,Chen Zhang,Lizhen Cui

2024-09-05

Abstract:Large Language Models (LLMs) may suffer from hallucinations in real-world applications due to the lack of relevant knowledge. In contrast, knowledge graphs encompass extensive, multi-relational structures that store a vast array of symbolic facts. Consequently, integrating LLMs with knowledge graphs has been extensively explored, with Knowledge Graph Question Answering (KGQA) serving as a critical touchstone for the integration. This task requires LLMs to answer natural language questions by retrieving relevant triples from knowledge graphs. However, existing methods face two significant challenges: \textit{excessively long reasoning paths distracting from the answer generation}, and \textit{false-positive relations hindering the path refinement}. In this paper, we propose an iterative interactive KGQA framework that leverages the interactive learning capabilities of LLMs to perform reasoning and Debating over Graphs (DoG). Specifically, DoG employs a subgraph-focusing mechanism, allowing LLMs to perform answer trying after each reasoning step, thereby mitigating the impact of lengthy reasoning paths. On the other hand, DoG utilizes a multi-role debate team to gradually simplify complex questions, reducing the influence of false-positive relations. This debate mechanism ensures the reliability of the reasoning process. Experimental results on five public datasets demonstrate the effectiveness and superiority of our architecture. Notably, DoG outperforms the state-of-the-art method ToG by 23.7\% and 9.1\% in accuracy on WebQuestions and GrailQA, respectively. Furthermore, the integration experiments with various LLMs on the mentioned datasets highlight the flexibility of DoG. Code is available at \url{<a class="link-external link-https" href="https://github.com/reml-group/DoG" rel="external noopener nofollow">this https URL</a>}.

Computation and Language,Artificial Intelligence

Learning Event Graph Knowledge for Abductive Reasoning

Enabling Abductive Learning to Exploit Knowledge Graph

Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation

Neural Probabilistic Logic Learning for Knowledge Graph Reasoning

Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoning

Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspective

Modeling Event-Pair Relations in External Knowledge Graphs for Script Reasoning.

Abductive Learning with Ground Knowledge Base.

Inductive Knowledge Graph Reasoning for Multi-batch Emerging Entities.

EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs

Abductive Knowledge Induction From Raw Data

LearnDA: Learnable Knowledge-Guided Data Augmentation for Event Causality Identification

ELG: An Event Logic Graph

LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities

Learning and reasoning with graph data

Overview of Knowledge Reasoning for Knowledge Graph

Learning Abduction under Partial Observability

International Workshop on Learning with Knowledge Graphs: Construction, Embedding, and Reasoning.

Approximate Ontology Reasoning for Domain-Specific Knowledge Graph based on Deep Learning

Causal Reinforcement Learning for Knowledge Graph Reasoning

Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models