KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversation

Hao Zhou,Chujie Zheng,Kaili Huang,Minlie Huang,Xiaoyan Zhu

DOI: https://doi.org/10.48550/arXiv.2004.04100

2020-04-09

Abstract:The research of knowledge-driven conversational systems is largely limited due to the lack of dialog data which consist of multi-turn conversations on multiple topics and with knowledge annotations. In this paper, we propose a Chinese multi-domain knowledge-driven conversation dataset, KdConv, which grounds the topics in multi-turn conversations to knowledge graphs. Our corpus contains 4.5K conversations from three domains (film, music, and travel), and 86K utterances with an average turn number of 19.0. These conversations contain in-depth discussions on related topics and natural transition between multiple topics. To facilitate the following research on this corpus, we provide several benchmark models. Comparative results show that the models can be enhanced by introducing background knowledge, yet there is still a large space for leveraging knowledge to model multi-turn conversations for further research. Results also show that there are obvious performance differences between different domains, indicating that it is worth to further explore transfer learning and domain adaptation. The corpus and benchmark models are publicly available.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the limitation of datasets in current knowledge - driven dialogue system research. Specifically, most of the existing dialogue datasets lack multi - turn dialogues, multi - topic discussions and knowledge annotations, which restricts the performance improvement and diversified applications of dialogue systems. To solve these problems, the author proposes a Chinese multi - domain knowledge - driven dialogue dataset named KdConv. This dataset has the following characteristics:

1. **Multi - domain coverage**: KdConv contains dialogues in three domains: movies, music and travel. There are 1,500 dialogues in each domain, with a total of 4,500 dialogues.
2. **Multi - turn dialogues**: On average, each dialogue contains about 19 turns, which is significantly longer than other existing datasets.
3. **Multi - topic discussions**: The number of topics involved in the dialogue ranges from 1 to 4, and the transitions between topics are natural, closer to real - human conversations.
4. **Knowledge annotations**: Each turn in each dialogue has relevant knowledge graph triple annotations, and these annotations can be used as supervision signals for knowledge - interaction modeling.

By constructing such a high - quality dataset, the author aims to promote the research of knowledge - driven dialogue systems, especially in multi - turn dialogues, multi - topic discussions and cross - domain adaptation. In addition, the paper also provides a benchmark model and verifies through experiments the role of introducing background knowledge in improving model performance, but also points out that existing models still have a great deal of room for improvement in generating knowledge - coherent dialogues.