Abstract:As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can offer reliable and up-to-date external knowledge, providing huge convenience for numerous tasks. Particularly in the era of AI-Generated Content (AIGC), the powerful capacity of retrieval in providing additional knowledge enables RAG to assist existing generative AI in producing high-quality outputs. Recently, Large Language Models (LLMs) have demonstrated revolutionary abilities in language understanding and generation, while still facing inherent limitations, such as hallucinations and out-of-date internal knowledge. Given the powerful abilities of RAG in providing the latest and helpful auxiliary information, Retrieval-Augmented Large Language Models (RA-LLMs) have emerged to harness external and authoritative knowledge bases, rather than solely relying on the model's internal knowledge, to augment the generation quality of LLMs. In this survey, we comprehensively review existing research studies in RA-LLMs, covering three primary technical perspectives: architectures, training strategies, and applications. As the preliminary knowledge, we briefly introduce the foundations and recent advances of LLMs. Then, to illustrate the practical significance of RAG for LLMs, we systematically review mainstream relevant work by their architectures, training strategies, and application areas, detailing specifically the challenges of each and the corresponding capabilities of RA-LLMs. Finally, to deliver deeper insights, we discuss current limitations and several promising directions for future research. Updated information about this survey can be found at <a class="link-external link-https" href="https://advanced-recommender-systems.github.io/RAG-Meets-LLMs/" rel="external noopener nofollow">this https URL</a>

ValuesRAG: Enhancing Cultural Alignment Through Retrieval-Augmented Contextual Learning

Self-Alignment: Improving Alignment of Cultural Values in LLMs via In-Context Learning

Contextual Moral Value Alignment Through Context-Based Aggregation

LLM-GLOBE: A Benchmark Evaluating the Cultural Values Embedded in LLM Output

RAG-Studio: Towards In-Domain Adaptation of Retrieval Augmented Generation Through Self-Alignment

A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models

Enabling Classifiers to Make Judgements Explicitly Aligned with Human Values

CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responses

Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensions

DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation

Does RAG Introduce Unfairness in LLMs? Evaluating Fairness in Retrieval-Augmented Generation Systems

The Generation Gap: Exploring Age Bias in the Value Systems of Large Language Models

WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Models

RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment

MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training

Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Values

Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology

CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models

RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation

Towards an End-to-End Personal Fine-Tuning Framework for AI Value Alignment

High-Dimension Human Value Representation in Large Language Models