Building Knowledge-Grounded Dialogue Systems with Graph-Based Semantic Modeling

Yizhe Yang,Heyan Huang,Yang Gao,Jiawei Li and

2024-05-16

Abstract:The knowledge-grounded dialogue task aims to generate responses that convey information from given knowledge documents. However, it is a challenge for the current sequence-based model to acquire knowledge from complex documents and integrate it to perform correct responses without the aid of an explicit semantic structure. To address these issues, we propose a novel graph structure, Grounded Graph ($G^2$), that models the semantic structure of both dialogue and knowledge to facilitate knowledge selection and integration for knowledge-grounded dialogue generation. We also propose a Grounded Graph Aware Transformer ($G^2AT$) model that fuses multi-forms knowledge (both sequential and graphic) to enhance knowledge-grounded response generation. Our experiments results show that our proposed model outperforms the previous state-of-the-art methods with more than 10\% gains in response generation and nearly 20\% improvement in factual consistency. Further, our model reveals good generalization ability and robustness. By incorporating semantic structures as prior knowledge in deep neural networks, our model provides an effective way to aid language generation.

Computation and Language

What problem does this paper attempt to address?

The paper attempts to address two main challenges in knowledge-guided dialogue systems:

1. **Knowledge Selection and Integration**: Current sequence-based models face difficulties in acquiring knowledge from complex documents and integrating it to generate correct responses. These models often struggle with long-distance dependencies and tend to overlook repetitive, redundant, or contradictory information.

2. **Generating Coherent and Informative Responses**: Existing knowledge-guided dialogue systems often lack coherence and informativeness in their responses, leading to a poor dialogue experience. Additionally, these models cannot update the knowledge in memory in real-time, which may result in outdated or inaccurate responses.

To address these issues, the authors propose a new approach called **Grounded Graph (𝐺2)**, which models the semantic structure of dialogue and knowledge through an explicit graph structure to facilitate knowledge selection and integration. Furthermore, the authors introduce the **Grounded Graph Aware Transformer (𝐺2𝐴𝑇)** model, which integrates multiple forms of knowledge (including sequences and graphs) to enhance knowledge-guided response generation. Experimental results show that this model significantly outperforms existing methods in response generation and factual consistency, with improvements of over 10% and nearly 20%, respectively.