Abstract:During multi-turn dialogue, with the increase in dialogue turns, the difficulty of intention recognition and the generation of the following sentence reply become more and more difficult. This paper mainly optimizes the context information extraction ability of the Seq2Seq Encoder in multi-turn dialogue modeling. We fuse the historical dialogue information and the current input statement information in the encoder to capture the context dialogue information better. Therefore, we propose a BERT-based fusion encoder ProBERT-To-GUR (PBTG) and an enhanced ELMO model 3-ELMO-Attention-GRU (3EAG). The two models mainly enhance the contextual information extraction capability of multi-turn dialogue. To verify the effectiveness of the two proposed models, we demonstrate the effectiveness of our model by combining data based on the LCCC-large multi-turn dialogue dataset and the Naturalconv multi-turn dataset. The experimental comparison results show that, in the multi-turn dialogue experiments of the open domain and fixed topic, the two Seq2Seq coding models proposed are significantly improved compared with the current state-of-the-art models. For specified topic multi-turn dialogue, the 3EAG model has the average BLEU value reaches the optimal 32.4, which achieves the best language generation effect, and the BLEU value in the actual dialogue verification experiment also surpasses 31.8. for open-domain multi-turn dialogue. The average BLEU value of the PBTG model reaches 31.8, the optimal 31.8 achieves the best language generation effect, and the BLEU value in the actual dialogue verification experiment surpasses 31.2. So, the 3EAG model is more suitable for fixed-topic multi-turn dialogues for the two tasks. The PBTG model is more muscular in open-domain multi-turn dialogue tasks; therefore, our model is significant for promoting multi-turn dialogue research.

A survey of multi-party dialogue research based on deep learning

Recent advances in deep learning based dialogue systems: a systematic survey

Deep Reinforcement Learning for Dialogue Generation

Teaching Machines to Converse

Advances in Multi-turn Dialogue Comprehension: A Survey

A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems

Learning Multi-Party Turn-Taking Models from Dialogue Logs

Talking with Machines: A Comprehensive Survey of Emergent Dialogue Systems

WavChat: A Survey of Spoken Dialogue Models

A survey on multi-agent deep reinforcement learning: from the perspective of challenges and applications

Improving Multi-Party Dialogue Discourse Parsing via Domain Integration

Recent Advances in Dialogue Machine Translation

Human–Machine Multi-Turn Language Dialogue Interaction Based on Deep Learning

Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey

Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models

Research on Oral English Dialogue Understanding Based on Deep Learning

Towards Social AI: A Survey on Understanding Social Interactions

A Review of Dialogue Systems: From Trained Monkeys to Stochastic Parrots

Deep Learning in Natural Language Processing: A State-of-the-Art Survey

Deep Learning for Visual Speech Analysis: A Survey

Research on the Design of Intelligent Chatbot Based on Deep Learning