Reinforcement Learning-based Knowledge Graph Reasoning for Explainable Fact-checking

Gustav Nikopensius,Mohit Mayank,Orchid Chetia Phukan,Rajesh Sharma
DOI: https://doi.org/10.48550/arXiv.2310.07613
2023-10-11
Abstract:Fact-checking is a crucial task as it ensures the prevention of misinformation. However, manual fact-checking cannot keep up with the rate at which false information is generated and disseminated online. Automated fact-checking by machines is significantly quicker than by humans. But for better trust and transparency of these automated systems, explainability in the fact-checking process is necessary. Fact-checking often entails contrasting a factual assertion with a body of knowledge for such explanations. An effective way of representing knowledge is the Knowledge Graph (KG). There have been sufficient works proposed related to fact-checking with the usage of KG but not much focus is given to the application of reinforcement learning (RL) in such cases. To mitigate this gap, we propose an RL-based KG reasoning approach for explainable fact-checking. Extensive experiments on FB15K-277 and NELL-995 datasets reveal that reasoning over a KG is an effective way of producing human-readable explanations in the form of paths and classifications for fact claims. The RL reasoning agent computes a path that either proves or disproves a factual claim, but does not provide a verdict itself. A verdict is reached by a voting mechanism that utilizes paths produced by the agent. These paths can be presented to human readers so that they themselves can decide whether or not the provided evidence is convincing or not. This work will encourage works in this direction for incorporating RL for explainable fact-checking as it increases trustworthiness by providing a human-in-the-loop approach.
Artificial Intelligence,Computers and Society
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the interpretability problem in automated fact - checking, especially by using Knowledge Graph (KG) and Reinforcement Learning (RL) to improve the transparency and credibility of fact - checking. Specifically, this research mainly focuses on the following aspects: 1. **Speed and efficiency of automated fact - checking**: With the rapid spread of false information on the Internet, manual fact - checking can no longer keep up with the speed of information generation and dissemination. Therefore, it is necessary to develop automated fact - checking tools to quickly process a large amount of information. 2. **Enhancing the interpretability of fact - checking**: In order to improve the transparency and trustworthiness of automated systems in the fact - checking process, easy - to - understand explanations must be provided. Traditional automated methods usually lack the ability to explain the decision - making process, making it difficult for users to trust their results. 3. **Introducing reinforcement learning for knowledge graph reasoning**: Although many studies have used knowledge graphs for fact - checking, few have explored how to apply reinforcement learning in this field. This paper proposes a reinforcement learning method based on multi - hop reasoning, which verifies or refutes fact claims by finding paths in the knowledge graph and provides human - readable explanations for these classification results. 4. **Providing a mechanism for human participation**: This method can not only automatically generate explanations, but also allow human readers to participate in the final judgment through a voting mechanism, thereby increasing the credibility and transparency of the system. #### Main contributions - **Applying multi - hop reasoning agents for interpretable fact - checking for the first time**: This research uses two commonly used knowledge graph data sets, FB15K - 277 and NELL - 995, to evaluate the model performance. - **Successfully achieving fact - checking and providing highly readable explanations**: The experimental results show that this method can effectively check facts and provide easy - to - understand explanations for classification results. - **Combining the policy network and the beam search algorithm**: In this way, the researchers increase the number and diversity of evidence paths extracted, further enhancing the system's explanatory ability. In conclusion, this paper provides a new, more interpretable framework for automated fact - checking by introducing reinforcement learning and knowledge graph reasoning, which helps to improve the efficiency and credibility of fact - checking.