MegaAgent: A Practical Framework for Autonomous Cooperation in Large-Scale LLM Agent Systems

Qian Wang,Tianyu Wang,Qinbin Li,Jingsheng Liang,Bingsheng He

2024-08-20

Abstract:With the emergence of large language models (LLMs), LLM-powered multi-agent systems (LLM-MA systems) have been proposed to tackle real-world tasks. However, their agents mostly follow predefined Standard Operating Procedures (SOPs) that remain unchanged across the whole interaction, lacking autonomy and scalability. Additionally, current solutions often overlook the necessity for effective agent cooperation. To address the above limitations, we propose MegaAgent, a practical framework designed for autonomous cooperation in large-scale LLM Agent systems. MegaAgent leverages the autonomy of agents to dynamically generate agents based on task requirements, incorporating features such as automatically dividing tasks, systematic planning and monitoring of agent activities, and managing concurrent operations. In addition, MegaAgent is designed with a hierarchical structure and employs system-level parallelism to enhance performance and boost communication. We demonstrate the effectiveness of MegaAgent through Gobang game development, showing that it outperforms popular LLM-MA systems; and national policy simulation, demonstrating its high autonomy and potential to rapidly scale up to 590 agents while ensuring effective cooperation among them. Our results indicate that MegaAgent is the first autonomous large-scale LLM-MA system with no pre-defined SOPs, high effectiveness and scalability, paving the way for further research in this field. Our code is at https://anonymous.4open.science/r/MegaAgent-81F3.

Multiagent Systems

What problem does this paper attempt to address?

The paper aims to address the issues encountered in practical applications of large-scale language model (LLM) multi-agent systems (LLM-MA systems), specifically:

1. **Lack of Autonomy**: Current LLM-MA systems mostly rely on predefined standard operating procedures (SOPs) that remain unchanged throughout the interaction process, resulting in a lack of autonomy and scalability in the system.

2. **Insufficient Cooperation**: Existing solutions often overlook the importance of effective cooperation, which is particularly crucial when dealing with complex tasks.

To address the above limitations, the authors propose the MegaAgent framework, which has the following features:
- **Dynamic Task Allocation**: Capable of dynamically generating agents based on task requirements and automatically dividing tasks.
- **System-Level Monitoring and Management**: Includes automatic task division, system planning and monitoring of agent activities, and management of concurrent operations.
- **Hierarchical Structure Design**: Adopts a layered structure, utilizing system-level parallelism to enhance performance and communication efficiency.

The effectiveness and scalability of MegaAgent are demonstrated through Go game development and national policy simulation experiments. Experimental results show that MegaAgent significantly outperforms other baseline models in terms of task completion speed and quality, and can support efficient collaboration of up to 590 agents. Additionally, MegaAgent is the first large-scale LLM-MA system that does not rely on predefined SOPs, possessing high autonomy and scalability, laying the foundation for further research in this field.