Enhancing LLM Intelligence with ARM-RAG: Auxiliary Rationale Memory for Retrieval Augmented Generation

Eric Melz

2023-11-08

Abstract:Large Language Models (LLMs) are smart but forgetful. Recent studies, (e.g., (Bubeck et al., 2023)) on modern LLMs have shown that they are capable of performing amazing tasks typically necessitating human-level intelligence. However, unlike humans, frozen LLMs do not improve over time; they neither acquire new knowledge nor learn from their successes or failures. Some approaches to improving the intelligence of LLMs include fine-tuning models based on problem-solving performance (Zelikman et al., 2022), and building bigger and more sophisticated models (Bubeck et al., 2023). However, these methods have the drawback of requiring substantial data and computational resources to retrain existing models. In this paper, we explore the use of Retrieval Augmented Generation, also known as RAG (Lewis et al., 2021) to improve problem-solving performance. We propose ARM-RAG (Auxiliary Rationale Memory for Retrieval Augmented Generation), a system that learns from its successes without incurring high training costs. We demonstrate that the storage and subsequent retrieval of reasoning chains have a positive influence on performance in grade-school math problems.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address the limitations of large language models (LLMs) in problem-solving, particularly the fact that these models, while intelligent, lack memory functionality and cannot acquire new knowledge over time or learn from past successes and failures. To tackle this issue, the paper proposes the ARM-RAG (Assisted Reasoning Memory Retrieval-Augmented Generation) system.

The main contributions of the paper are as follows:
1. **Proposing the ARM-RAG system**: This system utilizes Retrieval-Augmented Generation (RAG) technology to improve LLMs' performance in solving mathematical problems by storing and retrieving previously successful reasoning chains (referred to as "rationales").
2. **Experimental validation**: A series of experiments demonstrate the effectiveness of the ARM-RAG system, and it was found that the system's performance further improves when the target problem is fuzzily processed.
3. **Comparative experiments**: The effects of different prompting methods, including strong prompts and negative prompts, were compared to verify the impact of prompts on the system's performance.

The core hypothesis of the paper is that effective retrieval-augmented generation technology can significantly enhance the problem-solving capabilities of LLMs. Experimental results show that the ARM-RAG system outperforms baseline models on the training set, and its performance on the test set also improves, especially after applying fuzzy query techniques.