A survey on large language model based autonomous agents

Lei Wang,Chen Ma,Xueyang Feng,Zeyu Zhang,Hao Yang,Jingsen Zhang,Zhiyuan Chen,Jiakai Tang,Xu Chen,Yankai Lin,Wayne Xin Zhao,Zhewei Wei,Jirong Wen

DOI: https://doi.org/10.1007/s11704-024-40231-1

IF: 2.6688

2024-03-24

Frontiers of Computer Science

Abstract:Autonomous agents have long been a research focus in academic and industry communities. Previous research often focuses on training agents with limited knowledge within isolated environments, which diverges significantly from human learning processes, and makes the agents hard to achieve human-like decisions. Recently, through the acquisition of vast amounts of Web knowledge, large language models (LLMs) have shown potential in human-level intelligence, leading to a surge in research on LLM-based autonomous agents. In this paper, we present a comprehensive survey of these studies, delivering a systematic review of LLM-based autonomous agents from a holistic perspective. We first discuss the construction of LLM-based autonomous agents, proposing a unified framework that encompasses much of previous work. Then, we present a overview of the diverse applications of LLM-based autonomous agents in social science, natural science, and engineering. Finally, we delve into the evaluation strategies commonly used for LLM-based autonomous agents. Based on the previous studies, we also present several challenges and future directions in this field.

computer science, information systems, theory & methods, software engineering

What problem does this paper attempt to address?

This paper focuses on the research of autonomous agents based on large-scale language models (LLMs). Previous research on autonomous agents has typically been trained in isolated environments, which is far from the learning process of humans, making it difficult for these agents to achieve human-level decision-making abilities. In recent years, with the ability to acquire knowledge from a large amount of web data, LLMs have shown the potential to approach human intelligence, leading to an increasing number of studies using LLMs to build autonomous agents capable of making human-like decisions.

The paper conducted a comprehensive survey of these studies and proposed a unified framework to summarize previous work. The research mainly focuses on three aspects: the construction, application, and evaluation of autonomous agents. In terms of construction, the paper discusses how to design architectures to better utilize LLMs and how to inspire and enhance the agents' capabilities to perform different tasks. In terms of application, the paper outlines the diverse applications of LLM-based autonomous agents in social sciences, natural sciences, and engineering. Finally, the paper delves into the strategies for evaluating LLM-based autonomous agents, including subjective and objective methods.

The paper points out that although some independent models have been proposed previously, there is a lack of comprehensive summarization and comparison of these models. Therefore, a systematic review is crucial for understanding and advancing future research. The paper highlights the challenges in the field and proposes possible research directions, aiming to provide background knowledge for newcomers and promote more innovative research.