Abstract:The emergence of large language models (LLMs) has significantly advanced the simulation of believable interactive agents. However, the substantial cost on maintaining the prolonged agent interactions poses challenge over the deployment of believable LLM-based agents. Therefore, in this paper, we develop Affordable Generative Agents (AGA), a framework for enabling the generation of believable and low-cost interactions on both agent-environment and inter-agents levels. Specifically, for agent-environment interactions, we substitute repetitive LLM inferences with learned policies; while for inter-agent interactions, we model the social relationships between agents and compress auxiliary dialogue information. Extensive experiments on multiple environments show the effectiveness and efficiency of our proposed framework. Also, we delve into the mechanisms of emergent believable behaviors lying in LLM agents, demonstrating that agents can only generate finite behaviors in fixed environments, based upon which, we understand ways to facilitate emergent interaction behaviors. Our code is publicly available at: <a class="link-external link-https" href="https://github.com/AffordableGenerativeAgents/Affordable-Generative-Agents" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve This paper aims to address the cost issue of large language models (LLMs) when simulating credible interactive agents. Although LLMs have made significant progress in generating credible interactive agents, frequent and prolonged agent interactions can lead to high costs, limiting the deployment of these agents in large-scale application scenarios. For example, the cost issue is particularly prominent in simulating long-term, large-scale policy impacts and social phenomena, as well as in non-player character (NPC) applications in games. To solve this problem, the authors propose a framework called "Affordable Generative Agents" (AGA), which can significantly reduce interaction costs while maintaining credible behavior. Specifically, AGA achieves this goal in the following two ways: 1. **Agent-Environment Interaction**: By replacing repetitive LLM inference with learned strategies, it reduces the redundant cost of generating repetitive responses. 2. **Agent-Agent Interaction**: By modeling social relationships between agents and compressing auxiliary dialogue information, it reduces the generation of repetitive information in multi-turn interactions. Through extensive experiments in multiple environments, the authors demonstrate the effectiveness and efficiency of the AGA framework and delve into the mechanisms of LLM agents generating credible behavior, revealing the limitations of agent behavior in fixed environments. Based on this finding, the authors also propose a series of optimization strategies to generate richer credible behavior. ### Summary The main contributions of this paper include: - Proposing the AGA framework, a low-cost credible behavior simulation framework suitable for LLM agents in open-world scenarios. - Proposing a series of evaluation methods and conducting extensive experiments in benchmark environments to verify the effectiveness of the framework. - Analyzing the mechanisms of LLM agents generating credible behavior, demonstrating the upper limit of credible behavior, and proposing corresponding optimization strategies.

Affordable Generative Agents

Lyfe Agents: Generative agents for low-cost real-time social interactions

MetaAgents: Simulating Interactions of Human Behaviors for LLM-based Task-oriented Coordination via Collaborative Generative Agents

Generative Agents: Interactive Simulacra of Human Behavior

LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation

AGILE: A Novel Reinforcement Learning Framework of LLM Agents

Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models

Enabling Efficient Interaction between an Algorithm Agent and an LLM: A Reinforcement Learning Approach

Agentic Society: Merging skeleton from real world and texture from Large Language Model

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

CGMI: Configurable General Multi-Agent Interaction Framework

Assistive Large Language Model Agents for Socially-Aware Negotiation Dialogues

BudgetMLAgent: A Cost-Effective LLM Multi-Agent system for Automating Machine Learning Tasks

EduAgent: Generative Student Agents in Learning

Enabling Intelligent Interactions between an Agent and an LLM: A Reinforcement Learning Approach

STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making

Agents: An Open-source Framework for Autonomous Language Agents

ProAgent: Building Proactive Cooperative Agents with Large Language Models

The Rise and Potential of Large Language Model Based Agents: A Survey

AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors

Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents