STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making

Chuanhao Li,Runhan Yang,Tiankai Li,Milad Bafarassat,Kourosh Sharifi,Dirk Bergemann,Zhuoran Yang

2024-05-28

Abstract:Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments is hampered by significant limitations including poor mathematical reasoning, difficulty in following instructions, and a tendency to generate incorrect information. These deficiencies hinder their performance in strategic and interactive tasks that demand adherence to nuanced game rules, long-term planning, exploration in unknown environments, and anticipation of opponents' moves. To overcome these obstacles, this paper presents a novel LLM agent framework equipped with memory and specialized tools to enhance their strategic decision-making capabilities. We deploy the tools in a number of economically important environments, in particular bilateral bargaining and multi-agent and dynamic mechanism design. We employ quantitative metrics to assess the framework's performance in various strategic decision-making problems. Our findings establish that our enhanced framework significantly improves the strategic decision-making capability of LLMs. While we highlight the inherent limitations of current LLM models, we demonstrate the improvements through targeted enhancements, suggesting a promising direction for future developments in LLM applications for interactive environments.

Computation and Language,Computer Science and Game Theory

What problem does this paper attempt to address?

This paper focuses on addressing the limitations of large-scale language models (LLMs) in strategic multi-agent decision-making environments. While LLMs have shown remarkable performance in natural language processing, they suffer from deficiencies in mathematical reasoning, following instructions, and generating inaccurate information, which restricts their performance in strategic tasks that require subtle game rules, long-term planning, exploration of unknown environments, and predicting opponent actions. To address this, the paper proposes a new framework called STRIDE, which enhances the decision-making capabilities of LLMs by introducing memory and specialized tools.

The STRIDE framework consists of several key components, including:
1. Toolset: Divided into operation tools and interaction tools, which are used to support complex reasoning processes and effective interaction with the environment.
2. Inference module: Driven by pre-trained LLMs, it organizes the flow of information through a series of Thought units to perform structured reasoning and solve complex problems.
3. Working memory: Stores important parameters to cope with information loss during long-term decision-making processes.

The paper applies the STRIDE framework in bilateral negotiations, multi-agent dynamic mechanism design, and game playing scenarios, and evaluates its performance using quantitative metrics. The experimental results demonstrate that STRIDE significantly improves the ability of LLMs in strategic decision-making problems. Despite the inherent limitations of current LLM models, STRIDE showcases the potential of future LLMs in interactive environment applications through targeted enhancements.