Abstract:Retrieval-augmented generation (RAG) techniques leverage the in-context learning capabilities of large language models (LLMs) to produce more accurate and relevant responses. Originating from the simple 'retrieve-then-read' approach, the RAG framework has evolved into a highly flexible and modular paradigm. A critical component, the Query Rewriter module, enhances knowledge retrieval by generating a search-friendly query. This method aligns input questions more closely with the knowledge base. Our research identifies opportunities to enhance the Query Rewriter module to Query Rewriter+ by generating multiple queries to overcome the Information Plateaus associated with a single query and by rewriting questions to eliminate Ambiguity, thereby clarifying the underlying intent. We also find that current RAG systems exhibit issues with Irrelevant Knowledge; to overcome this, we propose the Knowledge Filter. These two modules are both based on the instruction-tuned Gemma-2B model, which together enhance response quality. The final identified issue is Redundant Retrieval; we introduce the Memory Knowledge Reservoir and the Retriever Trigger to solve this. The former supports the dynamic expansion of the RAG system's knowledge base in a parameter-free manner, while the latter optimizes the cost for accessing external knowledge, thereby improving resource utilization and response efficiency. These four RAG modules synergistically improve the response quality and efficiency of the RAG system. The effectiveness of these modules has been validated through experiments and ablation studies across six common QA datasets. The source code can be accessed at <a class="link-external link-https" href="https://github.com/Ancientshi/ERM4" rel="external noopener nofollow">this https URL</a>.

MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generation

ActiveRAG: Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents

Retrieval-Augmented Generation for Large Language Models: A Survey

SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains

DR-RAG: Applying Dynamic Document Relevance to Retrieval-Augmented Generation for Question-Answering

WeKnow-RAG: An Adaptive Approach for Retrieval-Augmented Generation Integrating Web Search and Knowledge Graphs

Meta Knowledge for Retrieval Augmented Large Language Models

Corrective Retrieval Augmented Generation

Improving Retrieval for RAG based Question Answering Models on Financial Documents

DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation

A Survey on Retrieval-Augmented Text Generation for Large Language Models

ChunkRAG: Novel LLM-Chunk Filtering Method for RAG Systems

Enhancing Retrieval and Managing Retrieval: A Four-Module Synergy for Improved Quality and Efficiency in RAG Systems

IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner Monologues

LongRAG: A Dual-Perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering

RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation

MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training

RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation

AssistRAG: Boosting the Potential of Large Language Models with an Intelligent Information Assistant

Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation