Citation-Enhanced Generation for LLM-based Chatbots

Weitao Li,Junkai Li,Weizhi Ma,Yang Liu

2024-03-04

Abstract:Large language models (LLMs) exhibit powerful general intelligence across diverse scenarios, including their integration into chatbots. However, a vital challenge of LLM-based chatbots is that they may produce hallucinated content in responses, which significantly limits their applicability. Various efforts have been made to alleviate hallucination, such as retrieval augmented generation and reinforcement learning with human feedback, but most of them require additional training and data annotation. In this paper, we propose a novel post-hoc Citation-Enhanced Generation (CEG) approach combined with retrieval argumentation. Unlike previous studies that focus on preventing hallucinations during generation, our method addresses this issue in a post-hoc way. It incorporates a retrieval module to search for supporting documents relevant to the generated content, and employs a natural language inference-based citation generation module. Once the statements in the generated content lack of reference, our model can regenerate responses until all statements are supported by citations. Note that our method is a training-free plug-and-play plugin that is capable of various LLMs. Experiments on various hallucination-related datasets show our framework outperforms state-of-the-art methods in both hallucination detection and response regeneration on three benchmarks. Our codes and dataset will be publicly available.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The paper attempts to address the issue that large language models (LLMs) may generate hallucinated content (i.e., fabricated or incorrect information) when producing responses, which severely limits their application in scenarios requiring high reliability, such as the medical and educational fields. Although previous research has tried to mitigate the hallucination problem through methods like retrieval-augmented generation and reinforcement learning with human feedback, these methods usually require additional training and data annotation, increasing the complexity and cost of application.

To this end, the paper proposes a new post-processing Citation-Enhanced Generation (CEG) method, which combines retrieval-augmented techniques. Unlike previous preprocessing methods, the CEG framework works after the response is generated, supporting the generated content by retrieving relevant documents and using Natural Language Inference (NLI) techniques to generate citations. If the generated content lacks references, the model will regenerate the response until all statements are supported by citations. This method reduces hallucinated content in the output and improves the model's reliability and practicality without requiring additional training or fine-tuning of existing LLMs.

Experimental results show that the CEG framework performs excellently in three hallucination-related benchmarks, not only surpassing existing methods in hallucination detection but also achieving significant progress in response regeneration. Additionally, the paper further validates the effectiveness and robustness of the CEG framework through ablation studies, performance comparisons of different retrieval models and NLI models, and hyperparameter analysis.