Abstract:Human language expression is based on the subjective construal of the situation instead of the objective truth conditions, which means that speakers' personalities and emotions after cognitive processing have an important influence on conversation. However, most existing datasets for conversational AI ignore human personalities and emotions, or only consider part of them. It's difficult for dialogue systems to understand speakers' personalities and emotions although large-scale pre-training language models have been widely used. In order to consider both personalities and emotions in the process of conversation generation, we propose CPED, a large-scale Chinese personalized and emotional dialogue dataset, which consists of multi-source knowledge related to empathy and personal characteristic. These knowledge covers gender, Big Five personality traits, 13 emotions, 19 dialogue acts and 10 scenes. CPED contains more than 12K dialogues of 392 speakers from 40 TV shows. We release the textual dataset with audio features and video features according to the copyright claims, privacy issues, terms of service of video platforms. We provide detailed description of the CPED construction process and introduce three tasks for conversational AI, including personality recognition, emotion recognition in conversations as well as personalized and emotional conversation generation. Finally, we provide baseline systems for these tasks and consider the function of speakers' personalities and emotions on conversation. Our motivation is to propose a dataset to be widely adopted by the NLP community as a new open benchmark for conversational AI research. The full dataset is available at https://github.com/scutcyr/CPED.

A Dataset for Research on Short-Text Conversations.

LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming

NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversation

Pchatbot: A Large-Scale Dataset for Personalized Chatbot

A Large-Scale Chinese Short-Text Conversation Dataset

Response Selection from Unstructured Documents for Human-Computer Conversation Systems

ConvSearch: A Open-Domain Conversational Search Behavior Dataset

A Survey on Response Selection for Retrieval-based Dialogues.

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World

Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System

MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation.

CMCC: A Comprehensive and Large-Scale Human-Human Dataset for Dialogue Systems

A Dataset for Sentence Retrieval for Open-Ended Dialogues

Building a Large-scale Persona Dialog Dataset

LCSTS: A Large Scale Chinese Short Text Summarization Dataset

Improving Contextual Language Models for Response Retrieval in Multi-Turn Conversation

Fine-Grained Sentence Functions for Short-Text Conversation

CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AI

A Manually Annotated Chinese Corpus for Non-task-oriented Dialogue Systems

The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents