CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Dataset

Qi Zhu,Kaili Huang,Zheng Zhang,Xiaoyan Zhu,Minlie Huang

DOI: https://doi.org/10.48550/arXiv.2002.11893

2020-02-28

Abstract:To advance multi-domain (cross-domain) dialogue modeling as well as alleviate the shortage of Chinese task-oriented datasets, we propose CrossWOZ, the first large-scale Chinese Cross-Domain Wizard-of-Oz task-oriented dataset. It contains 6K dialogue sessions and 102K utterances for 5 domains, including hotel, restaurant, attraction, metro, and taxi. Moreover, the corpus contains rich annotation of dialogue states and dialogue acts at both user and system sides. About 60% of the dialogues have cross-domain user goals that favor inter-domain dependency and encourage natural transition across domains in conversation. We also provide a user simulator and several benchmark models for pipelined task-oriented dialogue systems, which will facilitate researchers to compare and evaluate their models on this corpus. The large size and rich annotation of CrossWOZ make it suitable to investigate a variety of tasks in cross-domain dialogue modeling, such as dialogue state tracking, policy learning, user simulation, etc.

Computation and Language

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the lack of high - quality multi - domain (cross - domain) dialogue data in current task - oriented dialogue systems, especially the insufficiency of relevant data in the Chinese domain. Specifically, the paper proposes CrossWOZ, which is the first large - scale Chinese cross - domain task - oriented dialogue dataset. CrossWOZ aims to:

1. **Solve the problem of multi - domain dialogue modeling**: By providing a dataset with richly annotated dialogue states and dialogue behaviors, promote the research and development of multi - domain dialogue systems, especially in aspects such as dialogue state tracking, policy learning, and user simulation.

2. **Alleviate the shortage of Chinese task - oriented datasets**: Currently, most high - quality task - oriented dialogue datasets are in English, while relatively few are in Chinese. CrossWOZ fills this gap and provides a large amount of Chinese dialogue data, which is helpful for promoting the development of Chinese dialogue systems.

3. **Provide natural cross - domain dialogues**: Dialogues in CrossWOZ are not limited to a single domain but include interactions in multiple domains. These interactions occur naturally during the dialogue process and reflect real - life dialogue scenarios. Approximately 60% of the dialogues have cross - domain user goals, which encourages natural transitions between domains.

4. **Provide benchmark models and user simulators**: To facilitate researchers to compare and evaluate their models, the paper also provides a user simulator and several benchmark models, covering various modules of task - oriented dialogue systems, such as natural language understanding, dialogue state tracking, dialogue policy learning, and natural language generation.

In conclusion, the proposal of the CrossWOZ dataset aims to promote the research and development of multi - domain task - oriented dialogue systems and provide rich resources for the research of Chinese dialogue systems.