Abstract:Knowledge data are massive and widespread in the real-world, which can serve as good external sources to enrich conversations. however, in knowledge-grounded conversations, current models still lack the fine-grained control over knowledge selection and integration with dialogues, which finally leads to the knowledge-irrelevant response generation problems: 1) knowledge selection merely relies on the dialogue context, ignoring the inherent knowledge transitions along with conversation flows; 2) the models often over-fit during training, resulting with incoherent response by referring to unrelated tokens from specific knowledge content in the testing phase; 3) although response is generated upon the dialogue history and knowledge, the models often tend to overlook the selected knowledge, and hence generates knowledge-irrelevant response. To address these problems, we proposed to explicitly model the knowledge transition in sequential multi-turn conversations by abstracting knowledge into topic tags. Besides, to fully utilizing the selected knowledge in generative process, we propose pretraining a knowledge-aware response generator to pay more attention on the selected knowledge. In particular, a sequential knowledge transition model equipped with a pretrained knowledge-aware response generator (SKT-KG) formulates the high-level knowledge transition and fully utilizes the limited knowledge data. Experimental results on both structured and unstructured knowledge-grounded dialogue benchmarks indicate that our model achieves better performance over baseline models.

Learning to Express in Knowledge-Grounded Conversation

A Knowledge Enhanced Generative Conversational Service Agent

Knowledge-Grounded Dialogue Generation with Pre-trained Language Models

Knowledge-Grounded Dialogue with Reward-Driven Knowledge Selection

Improving Dialogue Generation via Proactively Querying Grounded Knowledge

Knowledge Grounded Pre-Trained Model for Dialogue Response Generation.

Infusing internalized knowledge of language models into hybrid prompts for knowledgeable dialogue generation

Building knowledge-grounded dialogue systems with graph-based semantic modeling

Select, Extend, and Generate: Generative Knowledge Selection for Open-Domain Dialogue Response Generation.

Prediction, Selection, and Generation: Exploration of Knowledge-Driven Conversation System

Adaptive Posterior Knowledge Selection for Improving Knowledge-Grounded Dialogue Generation

Learning to Select Knowledge for Response Generation in Dialog Systems

Augmenting Knowledge-grounded Conversations with Sequential Knowledge Transition.

Low-Resource Knowledge-Grounded Dialogue Generation

Generalizable and Explainable Dialogue Generation via Explicit Action Learning

Know Deeper: Knowledge-Conversation Cyclic Utilization Mechanism for Open-domain Dialogue Generation

Knowledge Bridging for Empathetic Dialogue Generation

Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation

Generating Dialogue Responses with Latent Lexical Meaning

Emotion-and-knowledge grounded response generation in an open-domain dialogue setting