BEKBQA: Improving Knowledge Base Question Answering with a Bidirectional Entity Scoring Model

Jiaming Li,Liang He,Hanhan Ma,Shaolei Wang,Sheng Yi,Weiwei Hu
DOI: https://doi.org/10.1109/prml59573.2023.10348352
2023-01-01
Abstract:Knowledge base multi-hop question answering must perform hop-by-hop reasoning on long paths to obtain answer entities. However, due to the lack of datasets with correct path annotations, the model’s training can only rely on the results of the last hop answer for updating. A more innovative approach is to apply the knowledge distillation method to the question-answering task, and the complex teacher model learns the entity distribution of each hop as the intermediate supervision signal of the student model. However, the structure of this dual model needs to be simplified. At the same time, in the backward reasoning process from the candidate answer entity to the topic entity, this method only uses the last hop result of the forward as the initialization, which does not guarantee that the backward reasoning process can conform to the semantic information of the question sentence. To address these challenges, we design a structurally simple model capable of constraining the intermediate reasoning process through forward and backward bidirectional reasoning. Moreover, we updated the initialization method of backward reasoning to make it more reasonable. At the same time, the main functions of the model are entirely based on the attention mechanism so that the results of each hop can be visualized and the reasoning process is transparent.
What problem does this paper attempt to address?