Reinforcement learning from constraints and focal entity shifting in conversational KGQA

Xirong Xu,Tao Xu,Ziming Wang,Haochen Li,Li Zhu,Xiaopeng Wei
DOI: https://doi.org/10.1007/s00521-023-09138-z
2023-11-20
Neural Computing and Applications
Abstract:The actual needs of users for information are often hidden in multiple question answering (QA) on the same topic. In order to generate answers to users’ current questions, a conversational QA system relies on getting external information from a knowledge graph (KG) and combining it with conversation history. Therefore, how to make full use of the information of KG and combining it with the conversation environment is the top priority. In a conversational knowledge graph question answering (KGQA) scenario, the follow-up questions are often incomplete and may contain a shift of focal entity. Considering and processing the constrained information which plays the key role in solving complex conversational KGQA is very important. In this paper, we propose a reinforcement learning (RL) model, which uses a dynamically maintained context entity set to capture the shift of the focal entity in the process of conversation. We then use the bidirectional encoder representations from transformers (BERT) pre-training model to obtain the semantic information from context questions and KG paths. Our model learns from not only the 1-hop path but also 2-hop path constraint of the KG at the same time and gives reward rules based on precision and certain rules, respectively. Compared with state-of-the-art methods on ConvQuestions, our model improves mean reciprocal rank (MRR) and precision at 1 (P@1) by a margin of 4.7%$$\%$$ and 4.3%$$\%$$, respectively. Experimental results on two datasets demonstrate the effectiveness of our proposed approach.
computer science, artificial intelligence
What problem does this paper attempt to address?