Abstract:How to effectively utilize the dialogue history is a crucial problem in multi-turn dialogue generation. Previous works usually employ various neural network architectures (e.g., recurrent neural networks, attention mechanisms, and hierarchical structures) to model the history. However, a recent empirical study by Sankar et al. has shown that these architectures lack the ability of understanding and modeling the dynamics of the dialogue history. For example, the widely used architectures are insensitive to perturbations of the dialogue history, such as words shuffling, utterances missing, and utterances reordering. To tackle this problem, we propose a Ranking Enhanced Dialogue generation framework in this paper. Despite the traditional representation encoder and response generation modules, an additional ranking module is introduced to model the ranking relation between the former utterance and consecutive utterances. Specifically, the former utterance and consecutive utterances are treated as query and corresponding documents, and both local and global ranking losses are designed in the learning process. In this way, the dynamics in the dialogue history can be explicitly captured. To evaluate our proposed models, we conduct extensive experiments on three public datasets, i.e., bAbI, PersonaChat, and JDC. Experimental results show that our models produce better responses in terms of both quantitative measures and human judgments, as compared with the state-of-the-art dialogue generation models. Furthermore, we give some detailed experimental analysis to show where and how the improvements come from.

Dialog generation based on hierarchical encoding and deep reinforcement learning

Hagan: Hierarchical Attentive Adversarial Learning For Task-Oriented Dialogue System

Deep Reinforcement Learning for Dialogue Generation

Hierarchy Response Learning for Neural Conversation Generation

Hierarchical Multi-turn Dialogue Generation Model Based on Double-layer Decoding

Investigating deep reinforcement learning techniques in personalized dialogue generation

A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues

Dialogue Generation Model with Hierarchical Encoding and Semantic Segmentation of Dialogue Context

Hierarchical Text Generation and Planning for Strategic Dialogue

Deep RL with Hierarchical Action Exploration for Dialogue Generation

Dirichlet Latent Variable Hierarchical Recurrent Encoder-Decoder in Dialogue Generation.

DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation

HL-EncDec: A Hybrid-Level Encoder-Decoder for Neural Response Generation.

Ranking Enhanced Dialogue Generation

Response Generation Via Structure-aware Constraints

Natural Language Generation by Hierarchical Decoding with Linguistic Patterns

Dynamic Multi-level Attention Models for Dialogue Response Generation.

DLCEncDec : A Fully Character-Level Encoder-Decoder Model for Neural Responding Conversation.

X-RECOSA: Multi-Scale Context Aggregation for Multi-Turn Dialogue Generation

Goal-Embedded Dual Hierarchical Model for Task-Oriented Dialogue Generation

Improve the Response Diversity of Multi-turn Dialogue System by Combining Knowledge