RAM: Towards an Ever-Improving Memory System by Learning from Communications

Jiaqi Li,Xiaobo Wang,Wentao Ding,Zihao Wang,Yipeng Kang,Zixia Jia,Zilong Zheng

2024-07-05

Abstract:We introduce an innovative RAG-based framework with an ever-improving memory. Inspired by humans'pedagogical process, RAM utilizes recursively reasoning-based retrieval and experience reflections to continually update the memory and learn from users' communicative feedback, namely communicative learning. Extensive experiments with both simulated and real users demonstrate significant improvements over traditional RAG and self-knowledge methods, particularly excelling in handling false premise and multi-hop questions. Furthermore, RAM exhibits promising adaptability to various feedback and retrieval methods, showcasing its potential for advancing AI capabilities in dynamic knowledge acquisition and lifelong learning.

Artificial Intelligence,Computation and Language

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to dynamically update and improve the memory system through communication feedback with users in artificial intelligence systems, in order to achieve continuous learning and knowledge accumulation. Specifically, the paper proposes an innovative Retrieval - Augmented Memory system (RAM), aiming to imitate the human teaching process, continuously update memory through recursive reasoning and experience reflection, and learn from users' communication feedback. This system is specifically targeted at the following challenges:

1. **Implicit knowledge representation**: Knowledge representation in pre - trained language models is usually implicit, which makes it difficult to modify or edit the pre - trained memory and may lead to the generation of incorrect information (i.e., "hallucination").
2. **Context window size limitation**: The context window size of pre - trained language models is limited, which restricts their ability to store all historical contexts as memory.
3. **Static knowledge**: Although traditional Retrieval - Augmented Generation (RAG) methods can access and precisely operate on memory, they usually rely on static external knowledge bases and have difficulty dealing with dynamically changing knowledge.

To solve these problems, the RAM system introduces Recursive Reasoning - based Retrieval (R3) and a memory reflection module, which continuously optimize and update memory through interaction feedback with users, thus showing significant advantages in dealing with multi - hop questions and false - premise questions. In addition, RAM also demonstrates good adaptability to different feedback forms and retrieval methods and has the potential to promote AI capabilities in terms of dynamic knowledge acquisition and lifelong learning.