Abstract:Exemplar-based generative models for open-domain conversation produce responses based on the exemplars provided by the retriever, taking advantage of generative models and retrieval models. However, they often ignore the retrieved exemplars while generating responses or produce responses over-fitted to the retrieved exemplars. In this paper, we argue that these drawbacks are derived from the one-to-many problem of the open-domain conversation. When the retrieved exemplar is relevant to the given context yet significantly different from the gold response, the exemplar-based generative models are trained to ignore the exemplar since the exemplar is not helpful for generating the gold response. On the other hand, when the retrieved exemplar is lexically similar to the gold response, the generative models are trained to rely on the exemplar highly. Therefore, we propose a training method selecting exemplars that are semantically relevant to the gold response but lexically distanced from the gold response to mitigate the above disadvantages. In the training phase, our proposed training method first uses the gold response instead of dialogue context as a query to select exemplars that are semantically relevant to the gold response. And then, it eliminates the exemplars that lexically resemble the gold responses to alleviate the dependency of the generative models on that exemplars. The remaining exemplars could be irrelevant to the given context since they are searched depending on the gold response. Thus, our proposed training method further utilizes the relevance scores between the given context and the exemplars to penalize the irrelevant exemplars. Extensive experiments demonstrate that our proposed training method alleviates the drawbacks of the existing exemplar-based generative models and significantly improves the performance in terms of appropriateness and informativeness.

Hi Model, generating 'nice' instead of 'good' is not as bad as generating 'rice'! Towards Context and Semantic Infused Dialogue Generation Loss Function and Evaluation Metric

A simple and efficient dialogue generation model incorporating commonsense knowledge

Saliency infused dialogue response generation: Improving task oriented text generation using feature attribution

On the Use of Linguistic Features for the Evaluation of Generative Dialogue Systems

Measuring and Improving Semantic Diversity of Dialogue Generation

Are Some Words Worth More than Others?

Polite Dialogue Generation Without Parallel Data

How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation

Learning to Compare for Better Training and Evaluation of Open Domain Natural Language Generation Models

Towards Better Open-Ended Text Generation: A Multicriteria Evaluation Framework

Persona-centric Metamorphic Relation guided Robustness Evaluation for Multi-turn Dialogue Modelling

Reinforcing Coherence for Sequence to Sequence Model in Dialogue Generation

Ranking Enhanced Dialogue Generation

Improving Context Modelling in Multimodal Dialogue Generation

Evaluate What You Can't Evaluate: Unassessable Quality for Generated Response

Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training

Beyond Accuracy Optimization: Computer Vision Losses for Large Language Model Fine-Tuning

On Accurate Evaluation of GANs for Language Generation

Understanding and Improving the Exemplar-based Generation for Open-domain Conversation

Dialogue Generation Model with Hierarchical Encoding and Semantic Segmentation of Dialogue Context

Emphasising Structured Information: Integrating Abstract Meaning Representation into LLMs for Enhanced Open-Domain Dialogue Evaluation