Abstract:Retrieval augmented generation has emerged as an effective method to enhance large language model performance. This approach typically relies on an internal retrieval module that uses various indexing mechanisms to manage a static pre-processed corpus. However, such a paradigm often falls short when it is necessary to integrate the most up-to-date information that has not been updated into the corpus during generative inference time. In this paper, we explore an alternative approach that leverages standard search engine APIs to dynamically integrate the latest online information (without maintaining any index for any fixed corpus), thereby improving the quality of generated content. We design a collaborative LLM-based paradigm, where we include: (i) a parser-LLM that determines if the Internet augmented generation is demanded and extracts the search keywords if so with a single inference; (ii) a mixed ranking strategy that re-ranks the retrieved HTML files to eliminate bias introduced from the search engine API; and (iii) an extractor-LLM that can accurately and efficiently extract relevant information from the fresh content in each HTML file. We conduct extensive empirical studies to evaluate the performance of this Internet search augmented generation paradigm. The experimental results demonstrate that our method generates content with significantly improved quality. Our system has been successfully deployed in a production environment to serve <a class="link-external link-http" href="http://01.AI" rel="external noopener nofollow">this http URL</a>'s generative inference requests.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to dynamically integrate the latest online information when large - language models (LLMs) generate content, in order to improve the quality of the generated content. Traditional retrieval - augmented generation (RAG) methods usually rely on an internal retrieval module, which uses various indexing mechanisms to manage static pre - processed corpora. However, this method often performs poorly when it is necessary to integrate the latest information, because this information may not have been updated in the corpus. Therefore, the author proposes a new method. By using standard search engine APIs (such as Google and Bing), the latest online information is dynamically integrated without maintaining any fixed - corpus index, thereby improving the quality of the generated content. Specifically, the main contributions of the paper include: 1. **Zero - Indexing Paradigm**: A new zero - indexing paradigm is proposed, introducing a set of core components to complete the task collaboratively. Specific implementations include: - **PARSER - LLM**: It is used to determine whether Internet - augmented generation is required and, if necessary, extract search keywords from the input request. - **Hybrid Ranking Strategy**: Re - rank the retrieved HTML files to reduce the bias introduced by the search engine API. - **EXTRACTOR - LLM**: It can efficiently and accurately extract relevant information from the fresh content of each HTML file. 2. **Design Principles and Implementation Details**: The design and implementation of the core components are introduced in detail: - **PARSER - LLM**: Build an instruction set to train PARSER - LLM, enabling it to follow multiple instructions and accurately extract search keywords. - **Hybrid Ranking Strategy**: Combine the dual granularity of fragments and complete content to provide more effective re - ranking. - **EXTRACTOR - LLM**: Train EXTRACTOR - LLM through supervised fine - tuning and direct preference optimization, enabling it to accurately extract relevant information and improve end - to - end generation quality. 3. **Empirical Evaluation**: A detailed empirical study has been carried out, and the results show that: - Compared with the traditional RAG paradigm, the proposed Internet - search - augmented generation paradigm generates content of higher quality and is more cost - effective in handling input tokens. - EXTRACTOR - LLM can accurately extract relevant information, and when there is no relevant content, it can robustly reject inappropriate content instead of generating hallucinations. Through these contributions, the paper aims to solve how to accurately understand and process user intentions in a dynamic environment and how to efficiently extract context - related information from retrieved HTML files, thereby improving the quality of the generated content.

Zero-Indexing Internet Search Augmented Generation for Large Language Models

Large Language Models are Built-in Autoregressive Search Engines

Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

Know Where to Go: Make LLM a Relevant, Responsible, and Trustworthy Searcher

Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learning

Think-then-Act: A Dual-Angle Evaluated Retrieval-Augmented Generation

Know where to go: Make LLM a relevant, responsible, and trustworthy searchers

KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models

GenSERP: Large Language Models for Whole Page Presentation

Large Search Model: Redefining Search Stack in the Era of LLMs

WeKnow-RAG: An Adaptive Approach for Retrieval-Augmented Generation Integrating Web Search and Knowledge Graphs

OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs

SearchLVLMs: A Plug-and-Play Framework for Augmenting Large Vision-Language Models by Searching Up-to-Date Internet Knowledge

Zero-shot Retrieval: Augmenting Pre-trained Models with Search Engines

Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers

Query in Your Tongue: Reinforce Large Language Models with Retrievers for Cross-lingual Search Generative Experience

A Survey of Generative Search and Recommendation in the Era of Large Language Models

Active Retrieval Augmented Generation

LLMGR: Large Language Model-based Generative Retrieval in Alipay Search

Synergistic Interplay between Search and Large Language Models for Information Retrieval

Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents