Abstract:Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating additional information from retrieval. However, studies have shown that LLMs still face challenges in effectively using the retrieved information, even ignoring it or being misled by it. The key reason is that the training of LLMs does not clearly make LLMs learn how to utilize input retrieved texts with varied quality. In this paper, we propose a novel perspective that considers the role of LLMs in RAG as ``Information Refiner'', which means that regardless of correctness, completeness, or usefulness of retrieved texts, LLMs can consistently integrate knowledge within the retrieved texts and model parameters to generate the texts that are more concise, accurate, and complete than the retrieved texts. To this end, we propose an information refinement training method named InFO-RAG that optimizes LLMs for RAG in an unsupervised manner. InFO-RAG is low-cost and general across various tasks. Extensive experiments on zero-shot prediction of 11 datasets in diverse tasks including Question Answering, Slot-Filling, Language Modeling, Dialogue, and Code Generation show that InFO-RAG improves the performance of LLaMA2 by an average of 9.39\% relative points. InFO-RAG also shows advantages in in-context learning and robustness of RAG.

What problem does this paper attempt to address?

The paper primarily investigates the issues of large language models (LLMs) within the retrieval-augmented generation (RAG) framework. Specifically, although RAG can enhance the performance of language models by retrieving additional information, existing LLMs still face challenges in effectively utilizing the retrieved information, including ignoring or being misled by it. The paper points out that the key reason is that LLMs are not explicitly trained to handle retrieved texts of varying quality. To address this issue, the paper proposes a new perspective, viewing LLMs as "information refiners." Regardless of whether the retrieved text is correct, complete, or useful, LLMs can integrate the knowledge from the retrieved text with the model parameters to generate text that is more concise, accurate, and complete than the original retrieved text. To achieve this goal, the paper introduces an unsupervised information refinement training method called INFO-RAG, aimed at optimizing the performance of LLMs in RAG tasks. The specific contributions of INFO-RAG are as follows: 1. Proposes a new perspective of viewing LLMs as "information refiners," enabling them to generate positive information gain in RAG scenarios. 2. Designs an unsupervised training method called INFO-RAG, allowing LLMs to perform information refinement in RAG. This method is cost-effective and applicable to various RAG tasks. 3. Conducts extensive experiments on multiple datasets, demonstrating that INFO-RAG can significantly improve the RAG performance of LLaMA2 in zero-shot predictions, covering tasks such as question answering, slot filling, language modeling, dialogue, and code generation. It also shows advantages in context learning and the robustness of RAG. In summary, the paper aims to improve the overall performance of RAG systems by enhancing the ability of LLMs to process retrieved information.

Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation

Retrieval-Augmented Generation for Large Language Models: A Survey

RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation

Auto-RAG: Autonomous Retrieval-Augmented Generation for Large Language Models

AssistRAG: Boosting the Potential of Large Language Models with an Intelligent Information Assistant

A Survey on Retrieval-Augmented Text Generation for Large Language Models

IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner Monologues

A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models

Fine-Grained Guidance for Retrievers: Leveraging LLMs' Feedback in Retrieval-Augmented Generation

R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation

SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains

Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG

DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation

Invar-RAG: Invariant LLM-aligned Retrieval for Better Generation

RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs

RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation

Benchmarking Large Language Models in Retrieval-Augmented Generation

MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training

Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Models