Improving knowledge-based dialogue generation through two-stage knowledge selection and knowledge selection-guided pointer network

Mengjuan Liu,Pei Zhao,Jiang Liu,Yulin Zhuang,Yunfan Yang
DOI: https://doi.org/10.1007/s10844-022-00709-5
2022-06-03
Journal of Intelligent Information Systems
Abstract:Existing End-to-End neural models for dialogue generation tend to generate generic and uninformative responses. Recently, knowledge-based dialogue models have been developed to generate more informative responses by leveraging external knowledge. However, it is still challenging for the models to select appropriate knowledge from an external knowledge base and generate responses coherent with the context and knowledge. In this paper, we propose a new method that uses two-stage knowledge selection to get proper knowledge for response generation without the guidance of ground-truth knowledge. Specifically, in the first stage the model selects knowledge according to the relevance between the context and candidate knowledge from a global perspective. During response generation, dynamic knowledge attention is performed to capture the knowledge relevant to the current decoding state, which is the second stage. Furthermore, we incorporate a knowledge selection-guided pointer network into the decoder to copy words from the captured knowledge. Experimental results on DuConv and Wizard-of-Wikipedia datasets demonstrate that our model can generate more coherent and informative responses than baselines do.
computer science, information systems, artificial intelligence
What problem does this paper attempt to address?