Abstract:In this work, we address challenging multi-agent cooperation problems with decentralized control, raw sensory observations, costly communication, and multi-objective tasks instantiated in various embodied environments. While previous research either presupposes a cost-free communication channel or relies on a centralized controller with shared observations, we harness the commonsense knowledge, reasoning ability, language comprehension, and text generation prowess of LLMs and seamlessly incorporate them into a cognitive-inspired modular framework that integrates with perception, memory, and execution. Thus building a Cooperative Embodied Language Agent CoELA, who can plan, communicate, and cooperate with others to accomplish long-horizon tasks efficiently. Our experiments on C-WAH and TDW-MAT demonstrate that CoELA driven by GPT-4 can surpass strong planning-based methods and exhibit emergent effective communication. Though current Open LMs like LLAMA-2 still underperform, we fine-tune a CoELA with data collected with our agents and show how they can achieve promising performance. We also conducted a user study for human-agent interaction and discovered that CoELA communicating in natural language can earn more trust and cooperate more effectively with humans. Our research underscores the potential of LLMs for future research in multi-agent cooperation. Videos can be found on the project website <a class="link-external link-https" href="https://vis-www.cs.umass.edu/Co-LLM-Agents/" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve This paper aims to address challenging issues in multi-agent cooperation, specifically including the following aspects: 1. **Decentralized Control**: Each agent acts independently without a central controller. 2. **Raw Sensory Observations**: Agents need to handle complex partial observation information. 3. **Expensive Communication**: High communication costs prevent arbitrary exchanges. 4. **Multi-Objective Tasks**: Completing multiple objectives over long time spans. The paper introduces large language models (LLMs) to build multi-agent systems capable of efficient cooperation and communication. Specifically, the research team proposes a cognitive framework named CoELA (Cooperative Embodied Language Agent), which integrates modules for perception, memory, communication, planning, and execution, leveraging the powerful capabilities of LLMs to achieve these functions. ### Overview of Experimental Results - **CoELA Cooperation with AI Agents**: CoELA demonstrated significantly better performance than baseline methods (such as MCTS-based Hierarchical Planner and Rule-based Hierarchical Planner) in two experimental environments (TDW-MAT and C-WAH). Notably, when two CoELAs worked together, their performance improved even more. - **Cooperation with Humans**: User studies showed that humans trust CoELA, which communicates in natural language, more and cooperate more efficiently with it. Additionally, the experiments validated the importance of various modules, especially the communication module, in human cooperation. ### Main Contributions 1. **Formalizing Multi-Agent Cooperation Problems**: The paper formalizes a multi-agent cooperation problem with decentralized control, complex partial observations, expensive communication, and multi-objective tasks, instantiated in two environments (C-WAH and TDW-MAT). 2. **Proposing a Novel Cognitive Framework**: A new cognitive heuristic modular framework is proposed, utilizing the powerful planning and communication capabilities of LLMs to construct CoELA, which outperforms planning-based methods. 3. **Evaluating Human-AI Cooperation**: Through user studies, the paper evaluates the potential for effective and trustworthy human-AI cooperation using LLMs.

Building Cooperative Embodied Agents Modularly with Large Language Models

Embodied LLM Agents Learn to Cooperate in Organized Teams

Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Game

Theory of Mind for Multi-Agent Collaboration via Large Language Models

Towards Collaborative Intelligence: Propagating Intentions and Reasoning for Multi-Agent Coordination with Large Language Models

MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration

LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models

Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents

CoAct: A Global-Local Hierarchy for Autonomous Agent Collaboration

MHRC: Closed-loop Decentralized Multi-Heterogeneous Robot Collaboration with Large Language Models

ProAgent: Building Proactive Cooperative Agents with Large Language Models

Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents

Cognitive Architectures for Language Agents

Building Open-Ended Embodied Agent via Language-Policy Bidirectional Adaptation

MetaAgents: Simulating Interactions of Human Behaviors for LLM-based Task-oriented Coordination via Collaborative Generative Agents

Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration

Chat with the Environment: Interactive Multimodal Perception Using Large Language Models

Your Co-Workers Matter: Evaluating Collaborative Capabilities of Language Models in Blocks World

Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models

MindAgent: Emergent Gaming Interaction