No Free Lunch: Retrieval-Augmented Generation Undermines Fairness in LLMs, Even for Vigilant Users

Mengxuan Hu,Hongyi Wu,Zihan Guan,Ronghang Zhu,Dongliang Guo,Daiqing Qi,Sheng Li

2024-10-10

Abstract:Retrieval-Augmented Generation (RAG) is widely adopted for its effectiveness and cost-efficiency in mitigating hallucinations and enhancing the domain-specific generation capabilities of large language models (LLMs). However, is this effectiveness and cost-efficiency truly a free lunch? In this study, we comprehensively investigate the fairness costs associated with RAG by proposing a practical three-level threat model from the perspective of user awareness of fairness. Specifically, varying levels of user fairness awareness result in different degrees of fairness censorship on the external dataset. We examine the fairness implications of RAG using uncensored, partially censored, and fully censored datasets. Our experiments demonstrate that fairness alignment can be easily undermined through RAG without the need for fine-tuning or retraining. Even with fully censored and supposedly unbiased external datasets, RAG can lead to biased outputs. Our findings underscore the limitations of current alignment methods in the context of RAG-based LLMs and highlight the urgent need for new strategies to ensure fairness. We propose potential mitigations and call for further research to develop robust fairness safeguards in RAG-based LLMs.

Information Retrieval,Computation and Language

What problem does this paper attempt to address?

The problem this paper attempts to address is whether Retrieval-Augmented Generation (RAG) technology, while improving the performance of large language models (LLMs), inadvertently harms the fairness of the models, even if users are highly vigilant about this issue.

Specifically, the authors propose and explore the following questions:

1. **Is the effectiveness and cost-efficiency of RAG truly a "free lunch"?** By introducing external datasets to enhance the generative capabilities of LLMs, RAG excels in reducing hallucinations and improving domain-specific generation capabilities. However, does this technology come with hidden fairness costs?
2. **How does the level of fairness awareness among different users affect the effectiveness of RAG?** The paper proposes a three-tier threat model, considering different levels of user awareness of fairness (low, medium, high), and how these varying levels of awareness lead to different degrees of fairness scrutiny in external datasets.
3. **Does RAG still result in unfair outputs even when using fully scrutinized datasets?** The study finds that even when using rigorously scrutinized datasets that are theoretically unbiased, RAG can still lead to the generation of biased content by the model.

Through these studies, the authors aim to reveal the potential fairness risks of RAG technology in practical applications and call for further research to develop more robust fairness protection measures.