Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models

Asher Sprigler,Alexander Drobek,Keagan Weinstock,Wendpanga Tapsoba,Gavin Childress,Andy Dao,Lucas Gral

2024-09-15

Abstract:Large Language Models (LLMs) have increasingly demonstrated the ability to facilitate the development of multi-agent systems that allow the interpretation of thoughts and actions generated by each individual. Promising advancements have also been made in LLM-based interaction with existing worlds, particularly in interacting with simulated environments. This paper aims to integrate both aforementioned topics (agents & world interaction) into a single simulation where multiple agents can work together to solve a problem, modeling how groups of humans can often solve problems better than individuals. By showing whether LLMs demonstrate the synergy of human collaboration, it could lead to advancements in the applications of LLMs. We implemented two simulations: a physical studio apartment with two roommates, and another where agents collaborate to complete a programming task. We provide a multi-agent framework, discuss the performance of the agents in each simulation, and discuss potential future additions.

Multiagent Systems,Artificial Intelligence,Computation and Language,Emerging Technologies

What problem does this paper attempt to address?

This paper aims to explore the application of large language models (LLMs) in multi-agent systems and attempts to address the following key issues:

1. **Multi-agent Collaboration**: Investigate how to construct a framework through LLMs that enables multiple agents to cooperate in a simulated environment to solve problems, simulating the advantages of human team collaboration.
2. **Environment Interaction**: Design a framework for agent-environment interaction, allowing agents to take actions based on the state of the environment and observe the results of these actions.
3. **Long-term Memory Mechanism**: To overcome the context window limitation of LLMs, introduce a long-term memory mechanism based on "observation" to ensure that agents can store and utilize historical information.
4. **Validation in Specific Application Scenarios**: Validate the effectiveness of the above methods through two specific scenarios (co-living agents in an apartment and collaboration on programming tasks).

Through these studies, the authors hope to demonstrate that LLMs can not only facilitate the development of multi-agent systems but also exhibit human-like collaboration efficiency in solving real-world problems. Additionally, the paper discusses the possibility of using open-source LLMs instead of proprietary models (such as OpenAI's ChatGPT) for research, emphasizing the flexibility and customizability advantages of this approach.