Abstract:During multi-turn dialogue, with the increase in dialogue turns, the difficulty of intention recognition and the generation of the following sentence reply become more and more difficult. This paper mainly optimizes the context information extraction ability of the Seq2Seq Encoder in multi-turn dialogue modeling. We fuse the historical dialogue information and the current input statement information in the encoder to capture the context dialogue information better. Therefore, we propose a BERT-based fusion encoder ProBERT-To-GUR (PBTG) and an enhanced ELMO model 3-ELMO-Attention-GRU (3EAG). The two models mainly enhance the contextual information extraction capability of multi-turn dialogue. To verify the effectiveness of the two proposed models, we demonstrate the effectiveness of our model by combining data based on the LCCC-large multi-turn dialogue dataset and the Naturalconv multi-turn dataset. The experimental comparison results show that, in the multi-turn dialogue experiments of the open domain and fixed topic, the two Seq2Seq coding models proposed are significantly improved compared with the current state-of-the-art models. For specified topic multi-turn dialogue, the 3EAG model has the average BLEU value reaches the optimal 32.4, which achieves the best language generation effect, and the BLEU value in the actual dialogue verification experiment also surpasses 31.8. for open-domain multi-turn dialogue. The average BLEU value of the PBTG model reaches 31.8, the optimal 31.8 achieves the best language generation effect, and the BLEU value in the actual dialogue verification experiment surpasses 31.2. So, the 3EAG model is more suitable for fixed-topic multi-turn dialogues for the two tasks. The PBTG model is more muscular in open-domain multi-turn dialogue tasks; therefore, our model is significant for promoting multi-turn dialogue research.

Overview of the NLPCC 2018 Shared Task: Multi-turn Human-Computer Conversations.

Overview of the NLPCC 2022 Shared Task: Multi-modal Dialogue Understanding and Generation

Overview of the NLPCC 2023 Shared Task 10: Learn to Watch TV: Multimodal Dialogue Understanding and Response Generation.

NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversation

Overview of the NLPCC 2018 Shared Task: Social Media User Modeling

Response Selection of Multi-turn Conversation with Deep Neural Networks.

Overview of the NLPCC-ICCPOL 2017 Shared Task: Social Media User Modeling

Overview of the NLPCC 2023 Shared Task 9: User Feedback Prediction and Response Generation.

Overview of the NLPCC 2018 Shared Task: Single Document Summarization.

Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset

Overview of the NLPCC 2022 Shared Task: Dialogue Text Analysis (DTA)

Overview of the NLPCC 2015 Shared Task: Weibo-Oriented Chinese News Summarization

Overview of NLPCC Shared Task 2: Multi-perspective Scientific Machine Reading Comprehension

Gated Multimodal Fusion with Contrastive Learning for Turn-taking Prediction in Human-robot Dialogue

TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World

Multi-view Response Selection for Human-Computer Conversation.

Modeling Multi-turn Conversation with Deep Utterance Aggregation

Building Emotional Conversation Systems Using Multi-task Seq2Seq Learning.

Human–Machine Multi-Turn Language Dialogue Interaction Based on Deep Learning

Joint Learning of Response Ranking and Next Utterance Suggestion in Human-Computer Conversation System.

Multimodal Dialogue Understanding via Holistic Modeling and Sequence Labeling.