Abstract:This paper introduces \textit{Federated Retrieval-Augmented Generation (FRAG)}, a novel database management paradigm tailored for the growing needs of retrieval-augmented generation (RAG) systems, which are increasingly powered by large-language models (LLMs). FRAG enables mutually-distrusted parties to collaboratively perform Approximate $k$-Nearest Neighbor (ANN) searches on encrypted query vectors and encrypted data stored in distributed vector databases, all while ensuring that no party can gain any knowledge about the queries or data of others. Achieving this paradigm presents two key challenges: (i) ensuring strong security guarantees, such as Indistinguishability under Chosen-Plaintext Attack (IND-CPA), under practical assumptions (e.g., we avoid overly optimistic assumptions like non-collusion among parties); and (ii) maintaining performance overheads comparable to traditional, non-federated RAG systems. To address these challenges, FRAG employs a single-key homomorphic encryption protocol that simplifies key management across mutually-distrusted parties. Additionally, FRAG introduces a \textit{multiplicative caching} technique to efficiently encrypt floating-point numbers, significantly improving computational performance in large-scale federated environments. We provide a rigorous security proof using standard cryptographic reductions and demonstrate the practical scalability and efficiency of FRAG through extensive experiments on both benchmark and real-world datasets.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve the challenges of secure and collaborative Retrieval - Augmented Generation (RAG) systems in distributed and federated environments. Specifically, it focuses on how to enable multiple distrusting parties to securely perform Approximate $k$-Nearest Neighbor (ANN) searches while ensuring the privacy of data and queries. #### Main problems: 1. **Privacy protection**: - In a federated environment, multiple organizations or entities (such as hospitals, financial institutions, etc.) hope to share data to improve the performance of machine - learning models, but this data usually contains sensitive information and cannot be directly shared. Therefore, a method is needed to ensure that data and queries are not leaked to other parties during transmission and processing. 2. **Performance efficiency**: - Existing privacy - protection technologies (such as secure multi - party computation and homomorphic encryption) are theoretically effective, but in practical applications, they often have high computational overhead and complex key - management problems, especially in real - time RAG systems. Therefore, a method that can ensure privacy and maintain high - performance efficiency is required. #### Specific objectives: - **ANN search in a federated environment**: Implement a framework that enables multiple distrusting parties to perform ANN searches on encrypted data vectors without exposing their original data and return the closest matching results. - **Security requirements**: Ensure that throughout the process, no party can obtain the data or query information of other parties, except for the final ANN results. In particular, the system must meet the security guarantee of Indistinguishability under Chosen - Plaintext Attack (IND - CPA). - **Performance requirements**: Minimize the computational and communication overheads related to encryption, query processing, and result aggregation, so that the performance of FRAG is comparable to that of centralized, plain - text ANN systems. #### Solutions: To address the above challenges, the paper proposes the Federated Retrieval - Augmented Generation (FRAG) framework, which includes the following key technologies: - **Single - Key Multiparty Homomorphic Encryption (SK - MHE)**: Simplifies key management, allowing all parties to use a single shared key for encryption operations, thereby reducing complexity and improving security. - **Multiplicative Caching (MC)**: Optimizes the performance of homomorphic operations by pre - computing and caching intermediate encrypted values, especially significantly reducing the computational burden in large - scale distributed environments. Through these innovations, FRAG provides a solution for efficient and secure ANN searches in federated environments, which is suitable for various real - world application scenarios, such as collaborative medical research, federated financial analysis, and multi - institutional secure machine learning.

FRAG: Toward Federated Vector Database Management for Collaborative and Secure Retrieval-Augmented Generation

CORAG: A Cost-Constrained Retrieval Optimization System for Retrieval-Augmented Generation

R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation

On the Vulnerability of Applying Retrieval-Augmented Generation within Knowledge-Intensive Application Domains

Certifiably Robust RAG against Retrieval Corruption

CoFE-RAG: A Comprehensive Full-chain Evaluation Framework for Retrieval-Augmented Generation with Enhanced Data Diversity

Privacy-Preserving Retrieval Augmented Generation with Differential Privacy

The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG)

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation

LightRAG: Simple and Fast Retrieval-Augmented Generation

RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation

Federated Recommendation via Hybrid Retrieval Augmented Generation

EasyRAG: Efficient Retrieval-Augmented Generation Framework for Automated Network Operations

PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design

FeB4RAG: Evaluating Federated Search in the Context of Retrieval Augmented Generation

FunnelRAG: A Coarse-to-Fine Progressive Retrieval Paradigm for RAG

Don't forget private retrieval: distributed private similarity search for large language models

EACO-RAG: Edge-Assisted and Collaborative RAG with Adaptive Knowledge Update

RAG Foundry: A Framework for Enhancing LLMs for Retrieval Augmented Generation

RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems

Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting