Abstract:Task-oriented dialogue system is commonly formulated as a reinforcement learning problem. A reward served as a learning objective is offered at the end of the generated dialogue to help optimize the system. As fulfilling a specific task often takes many turns between the system and the user, a scalar reward signal after this long process can be delayed and sparse. To address the above problems in the reinforcement learning (RL) based task-completion system, we propose a novel hierarchical attentive adversarial network HaGAN which features a cascaded attentive generator CAG that explores a state-action space to generate a dialogue and global-local attentive discriminators GLAD to give a relevant reward at multi-scale dialogue states. Specifically, after every turn of the dialogue generation, the turn-based discriminator tests the current turn and give a local reward representing the generator's current generating ability. When the dialogue finishes, the dialogue-based discriminator gives a global reward concerns the whole dialog. Finally, a synthesized reward computed by combining global and local reward is returned to the generator. By doing so, the generator is able to generate globally and locally fluent and informative dialogues. Through experiments on two public benchmark datasets demonstrate the superiority of our HaGAN over other representative state-of-the-art methods.

Adversarial Response Generation Against Topic Relevance

Hagan: Hierarchical Attentive Adversarial Learning For Task-Oriented Dialogue System

Adversarial Learning for Neural Dialogue Generation.

EnsembleGAN: Adversarial Learning for Retrieval-Generation Ensemble Model on Short-Text Conversation

Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access

Retrieval-Enhanced Adversarial Training for Neural Response Generation

Knowledge-aware Attentive Wasserstein Adversarial Dialogue Response Generation

Relevance is a Guiding Light: Relevance-aware Adaptive Learning for End-to-end Task-oriented Dialogue System

Open Domain Response Generation Guided by Retrieved Conversations

An Adversarially-Learned Turing Test for Dialog Generation Models

Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluation

Are You Talking to Me? Reasoned Visual Dialog Generation Through Adversarial Learning

Towards Robust Online Dialogue Response Generation

Diversifying Emotional Dialogue Generation via Selective Adversarial Training

DAL: Dual Adversarial Learning for Dialogue Generation.

Topic Enhanced Controllable CVAE for Dialogue Generation (student Abstract).

Adversarial Conversational Shaping for Intelligent Agents

Adaptive Bridge Between Training and Inference for Dialogue Generation

Diversity-Promoting GAN: A Cross-Entropy Based Generative Adversarial Network for Diversified Text Generation

Modeling Topical Relevance for Multi-Turn Dialogue Generation

Promoting Diversity for End-to-End Conversation Response Generation.