Teacher-Student Framework Enhanced Multi-domain Dialogue Generation

Shuke Peng,Xinjing Huang,Zehao Lin,Feng Ji,Haiqing Chen,Yin Zhang
DOI: https://doi.org/10.48550/arxiv.1908.07137
2019-01-01
Abstract:Dialogue systems dealing with multi-domain tasks are highly required. How torecord the state remains a key problem in a task-oriented dialogue system.Normally we use human-defined features as dialogue states and apply a statetracker to extract these features. However, the performance of such a system islimited by the error propagation of a state tracker. In this paper, we proposea dialogue generation model that needs no external state trackers and stillbenefits from human-labeled semantic data. By using a teacher-studentframework, several teacher models are firstly trained in their individualdomains, learn dialogue policies from labeled states. And then the learnedknowledge and experience are merged and transferred to a universal studentmodel, which takes raw utterance as its input. Experiments show that thedialogue system trained under our framework outperforms the one uses a belieftracker.
What problem does this paper attempt to address?