Abstract:This paper develops theory and algorithms for interacting large language model agents (LLMAs) using methods from statistical signal processing and microeconomics. While both fields are mature, their application to decision-making by interacting LLMAs remains unexplored. Motivated by Bayesian sentiment analysis on online platforms, we construct interpretable models and stochastic control algorithms that enable LLMAs to interact and perform Bayesian inference. Because interacting LLMAs learn from prior decisions and external inputs, they exhibit bias and herding behavior. Thus, developing interpretable models and stochastic control algorithms is essential to understand and mitigate these behaviors. This paper has three main results. First, we show using Bayesian revealed preferences from microeconomics that an individual LLMA satisfies the sufficient conditions for rationally inattentive (bounded rationality) utility maximization and, given an observation, the LLMA chooses an action that maximizes a regularized utility. Second, we utilize Bayesian social learning to construct interpretable models for LLMAs that interact sequentially with each other and the environment while performing Bayesian inference. Our models capture the herding behavior exhibited by interacting LLMAs. Third, we propose a stochastic control framework to delay herding and improve state estimation accuracy under two settings: (a) centrally controlled LLMAs and (b) autonomous LLMAs with incentives. Throughout the paper, we demonstrate the efficacy of our methods on real datasets for hate speech classification and product quality assessment, using open-source models like Mistral and closed-source models like ChatGPT. The main takeaway of this paper, based on substantial empirical analysis and mathematical formalism, is that LLMAs act as rationally bounded Bayesian agents that exhibit social learning when interacting.

Beyond the Black Box: A Statistical Model for LLM Reasoning and Inference

Large Language Models Are In-Context Semantic Reasoners Rather Than Symbolic Reasoners

LLMExplainer: Large Language Model based Bayesian Inference for Graph Explanation Generation

Bayesian Statistical Modeling with Predictors from LLMs

In-Context Explainers: Harnessing LLMs for Explaining Black Box Models

Can LLMs Compute with Reasons?

A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners

Amortizing intractable inference in large language models

LLM2: Let Large Language Models Harness System 2 Reasoning

Regression-aware Inference with LLMs

LLM Processes: Numerical Predictive Distributions Conditioned on Natural Language

Does Reasoning Emerge? Examining the Probabilities of Causation in Large Language Models

Interacting Large Language Model Agents. Interpretable Models and Social Learning

LLMs are Not Just Next Token Predictors

Reasoning over Uncertain Text by Generative Large Language Models

A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences

Sparsity-Guided Holistic Explanation for LLMs with Interpretable Inference-Time Intervention

Verbalized Probabilistic Graphical Modeling with Large Language Models

Hint Marginalization for Improved Reasoning in Large Language Models