Self-evolving Agents with reflective and memory-augmented abilities

Xuechen Liang,Meiling Tao,Yinghui Xia,Tianyu Shi,Jun Wang,JingSong Yang
2024-09-02
Abstract:Large language models (LLMs) have made significant advances in the field of natural language processing, but they still face challenges such as continuous decision-making. In this research, we propose a novel framework by integrating iterative feedback, reflective mechanisms, and a memory optimization mechanism based on the Ebbinghaus forgetting curve, it significantly enhances the agents' capabilities in handling multi-tasking and long-span information.
Computation and Language
What problem does this paper attempt to address?
The paper aims to address several key challenges faced by large language models (LLMs) in dynamic environments, including continuous decision-making capabilities, lack of long-term memory mechanisms, and limited context windows. Specifically, the paper proposes an innovative framework called Self-evolving Agents with Reflective and Memory-augmented Abilities (SAGE). The SAGE framework enhances the capabilities of agents in the following ways: 1. **Introduction of a reflective mechanism**: Enhances the agent's self-adjustment ability, enabling it to utilize historical information more effectively and make efficient decisions when faced with complex tasks. 2. **Memory optimization mechanism based on the Ebbinghaus forgetting curve**: Helps the agent selectively retain key information, optimize information storage and transmission, and reduce unnecessary cognitive load. Experimental results show that the SAGE framework significantly improves model performance in multiple benchmarks, particularly excelling in smaller models. For example, in the AgentBench test, SAGE improved the performance of powerful LLMs such as GPT-3.5 and GPT-4 by up to 2.26 times. For open-source models, performance improvements ranged from 57.7% to 100%. Additionally, SAGE achieved the best results in tasks such as multi-source question answering and code generation. In summary, the SAGE framework not only enhances the performance of existing powerful baseline models but also significantly boosts the performance of open-source models.