Abstract:Large Language Models (LLMs) have demonstrated remarkable generation capabilities but often struggle to access up-to-date information, which can lead to hallucinations. Retrieval-Augmented Generation (RAG) addresses this issue by incorporating knowledge from external databases, enabling more accurate and relevant responses. Due to the context window constraints of LLMs, it is impractical to input the entire external database context directly into the model. Instead, only the most relevant information, referred to as chunks, is selectively retrieved. However, current RAG research faces three key challenges. First, existing solutions often select each chunk independently, overlooking potential correlations among them. Second, in practice the utility of chunks is non-monotonic, meaning that adding more chunks can decrease overall utility. Traditional methods emphasize maximizing the number of included chunks, which can inadvertently compromise performance. Third, each type of user query possesses unique characteristics that require tailored handling, an aspect that current approaches do not fully consider. To overcome these challenges, we propose a cost constrained retrieval optimization system CORAG for retrieval-augmented generation. We employ a Monte Carlo Tree Search (MCTS) based policy framework to find optimal chunk combinations sequentially, allowing for a comprehensive consideration of correlations among chunks. Additionally, rather than viewing budget exhaustion as a termination condition, we integrate budget constraints into the optimization of chunk combinations, effectively addressing the non-monotonicity of chunk utility.

Retro-li: Small-Scale Retrieval Augmented Generation Supporting Noisy Similarity Searches and Domain Shift Generalization

Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts

Toward Optimal Search and Retrieval for RAG

RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation

Towards Optimizing a Retrieval Augmented Generation using Large Language Model on Academic Data

Optimizing Query Generation for Enhanced Document Retrieval in RAG

Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers

Retrieval-Augmented Generation for Large Language Models: A Survey

R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation

MemoRAG: Moving towards Next-Gen RAG Via Memory-Inspired Knowledge Discovery

LightRAG: Simple and Fast Retrieval-Augmented Generation

Retriever-and-Memory: Towards Adaptive Note-Enhanced Retrieval-Augmented Generation

Enhancing Retrieval Processes for Language Generation with Augmented Queries

RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems

The Power of Noise: Redefining Retrieval for RAG Systems

Corrective Retrieval Augmented Generation

SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains

RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation

Invar-RAG: Invariant LLM-aligned Retrieval for Better Generation

CORAG: A Cost-Constrained Retrieval Optimization System for Retrieval-Augmented Generation

Reducing hallucination in structured outputs via Retrieval-Augmented Generation