Dual Contrastive Learning for Unsupervised Knowledge Selection

Xiang Cao,Lei Wang,Yujiu Yang
DOI: https://doi.org/10.18293/seke2022-054
2022-01-01
Abstract:Although dialogue systems based on the Seq2Seq model have achieved success, they suffer from tending to generate general responses.Recent works have shown that selecting external knowledge is helpful for dialogue systems to generate informative and diverse responses.However, selecting appropriate knowledge from an unlabeled knowledge set, which is referred to as unsupervised knowledge selection, remains a tricky challenge.Therefore, we propose a dual contrastive method, which utilizes two source-target pairs which are based on the same knowledge set to construct dual contrasts.Specifically, for a source utterance, we consider its paired and unpaired target response as a positive and negative sample, then obtain the positive and negative posterior distribution over the knowledge candidates set, respectively.Then we lead the prior distribution to be close to the positive posterior distribution and distant from the negative one.Similarly, the posterior distribution is treated with the same criterion.Experimental results show that our method improves generated responses in terms of BLUE, DISTINCT, and knowledge utilization.Our codes are available at https://github.com/CaoXiang1997/DualCL4UKS.
What problem does this paper attempt to address?