Abstract:Retrieving proper domain knowledge from an external database lies at the heart of end-to-end task-oriented dialog systems to generate informative responses. Most existing systems blend knowledge retrieval with response generation and optimize them with direct supervision from reference responses, leading to suboptimal retrieval performance when the knowledge base becomes large-scale. To address this, we propose to decouple knowledge retrieval from response generation and introduce a multi-grained knowledge retriever (MAKER) that includes an entity selector to search for relevant entities and an attribute selector to filter out irrelevant attributes. To train the retriever, we propose a novel distillation objective that derives supervision signals from the response generator. Experiments conducted on three standard benchmarks with both small and large-scale knowledge bases demonstrate that our retriever performs knowledge retrieval more effectively than existing methods. Our code has been made publicly available.\footnote{<a class="link-external link-https" href="https://github.com/18907305772/MAKER" rel="external noopener nofollow">this https URL</a>}

What problem does this paper attempt to address?

The paper aims to address the issue of knowledge retrieval in end-to-end task-oriented dialogue systems (E2E-TOD), particularly how to improve the effectiveness of knowledge retrieval when dealing with large-scale knowledge bases. Specifically, existing E2E-TOD systems typically mix knowledge retrieval with response generation and optimize through direct supervision by referencing responses. This approach can lead to suboptimal knowledge retrieval performance in the context of large-scale knowledge bases. To solve this problem, the authors propose a Multi-granularity Knowledge Retriever (MAKER), which decouples knowledge retrieval from response generation and introduces an entity selector and an attribute selector to retrieve relevant entities and their attributes from the knowledge base. The main contributions of MAKER include: 1. **Decoupling Knowledge Retrieval and Response Generation**: By separating the knowledge retrieval process from the response generation process, the system's flexibility and efficiency are improved. 2. **Multi-granularity Knowledge Retrieval**: Not only does it retrieve entities, but it also further filters out relevant attributes within the entities, achieving finer-grained knowledge retrieval. 3. **Training Method**: It uses the cross-attention scores of the response generator as a supervision signal to train the retriever, which better guides the retriever's learning. Experimental results show that on knowledge bases of different scales, MAKER demonstrates significant advantages in knowledge retrieval compared to existing methods. Especially when dealing with large-scale knowledge bases, its performance is markedly superior to baseline methods. This indicates that MAKER effectively addresses the knowledge retrieval problem in the context of large-scale knowledge bases.

Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog

Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems

Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue System

A Multi Domain Knowledge Enhanced Matching Network for Response Selection in Retrieval-Based Dialogue Systems

Learning to Match Representations is Better for End-to-End Task-Oriented Dialog System

End-to-End Task-Oriented Dialogue System with Distantly Supervised Knowledge Base Retriever

Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems

Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retriever

Dynamically Retrieving Knowledge via Query Generation for Informative Dialogue Generation

More is Better: Enhancing Open-Domain Dialogue Generation via Multi-Source Heterogeneous Knowledge

Reciprocal Learning of Knowledge Retriever and Response Ranker for Knowledge-Grounded Conversations.

Knowledge Augmented Dialogue Generation with Divergent Facts Selection

External knowledge document retrieval strategy based on intention-guided and meta-learning for task-oriented dialogues

Coarse-to-Fine Knowledge Selection for Document Grounded Dialogs.

Retrieval-free Knowledge Injection Through Multi-Document Traversal for Dialogue Models.

Read Then Respond: Multi-granularity Grounding Prediction for Knowledge-Grounded Dialogue Generation.

Enhancing Multimodal Query Representation via Visual Dialogues for End-to-End Knowledge Retrieval

Improving Knowledge-Aware Dialogue Response Generation by Using Human-Written Prototype Dialogues.

Improving knowledge-based dialogue generation through two-stage knowledge selection and knowledge selection-guided pointer network

Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems

UniRetriever: Multi-task Candidates Selection for Various Context-Adaptive Conversational Retrieval