Abstract:End-to-end (E2E) task-oriented dialogue (ToD) systems are prone to fall into the so-called "likelihood trap", resulting in generated responses which are dull, repetitive, and often inconsistent with dialogue history. Comparing ranked lists of multiple generated responses against the "gold response" (from evaluation data) reveals a wide diversity in response quality, with many good responses placed lower in the ranked list. The main challenge, addressed in this work, is then how to reach beyond greedily generated system responses, that is, how to obtain and select such high-quality responses from the list of overgenerated responses at inference without availability of the gold response. To this end, we propose a simple yet effective reranking method which aims to select high-quality items from the lists of responses initially overgenerated by the system. The idea is to use any sequence-level (similarity) scoring function to divide the semantic space of responses into high-scoring versus low-scoring partitions. At training, the high-scoring partition comprises all generated responses whose similarity to the gold response is higher than the similarity of the greedy response to the gold response. At inference, the aim is to estimate the probability that each overgenerated response belongs to the high-scoring partition, given only previous dialogue history. We validate the robustness and versatility of our proposed method on the standard MultiWOZ dataset: our methods improve a state-of-the-art E2E ToD system by 2.0 BLEU, 1.6 ROUGE, and 1.3 METEOR scores, achieving new peak results. Additional experiments on the BiTOD dataset and human evaluation further ascertain the generalisability and effectiveness of the proposed framework.

From Retrieval to Generation: A Simple and Unified Generative Model for End-to-End Task-Oriented Dialogue

Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue System

Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems

Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems

Retrieval-guided Dialogue Response Generation Via a Matching-to-Generation Framework.

Autoregressive Entity Generation for End-to-End Task-Oriented Dialog.

End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions

An Effective Context‐focused Hierarchical Mechanism for Task‐oriented Dialogue Response Generation

Generative commonsense knowledge subgraph retrieval for open-domain dialogue response generation

Learning Personalized End-to-End Task-Oriented Dialogue Generation

Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems

Select, Extend, and Generate: Generative Knowledge Selection for Open-Domain Dialogue Response Generation.

Promoting Diversity for End-to-End Conversation Response Generation.

Unikdd: A Unified Generative Model for Knowledge-Driven Dialogue

What Are the Generator Preferences for End-to-end Task-Oriented Dialog System?

AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialog

Dual Dynamic Memory Network for End-to-End Multi-turn Task-oriented Dialog Systems.

Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retriever

Improving knowledge-based dialogue generation through two-stage knowledge selection and knowledge selection-guided pointer network

Generating Diverse Conversation Responses by Creating and Ranking Multiple Candidates

Pan More Gold from the Sand: Refining Open-domain Dialogue Training with Noisy Self-Retrieval Generation