Abstract:Practical mechanisms often limit agent reports to constrained formats like trades or orderings, potentially limiting the information agents can express. We propose a novel class of mechanisms that elicit agent reports in natural language and leverage the world-modeling capabilities of large language models (LLMs) to select outcomes and assign payoffs. We identify sufficient conditions for these mechanisms to be incentive-compatible and efficient as the LLM being a good enough world model and a strong inter-agent information over-determination condition. We show situations where these LM-based mechanisms can successfully aggregate information in signal structures on which prediction markets fail.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the limitations of information expression and aggregation in traditional mechanism design. Specifically:
1. **Limitations of information expression**: Traditional mechanisms usually limit the reporting format of agents to simplified forms (such as transactions or rankings), which may limit the amount of information that agents can express, especially when agents have complex, high - dimensional private information.
2. **Inefficiency of information aggregation**: Due to limited information expression, traditional mechanisms cannot effectively aggregate distributed information in some cases, resulting in sub - optimal results. For example, in prediction markets, when individual signals are not sufficient to significantly change the expected value, individual participants have no incentive to participate in trading.
To solve these problems, the paper proposes a new mechanism - **Language Model Mechanisms (LMMs)**, which uses large language models (LLMs) to process natural - language reports, thereby enabling richer information exchange, and performing result selection and payment distribution through LLMs. The main contributions of the paper include:
1. **Introduction of LMMs**: Allows agents to submit reports in natural - language form, enriching the form of information exchange.
2. **Identification of sufficient conditions for incentive compatibility and efficiency**: These conditions are based on the ability of LLMs as world models and the inter - agent information over - determination condition.
3. **Demonstration of application scenarios**: In cases where traditional mechanisms (such as prediction markets) fail, LMMs can successfully aggregate information.
### Summary of Mathematical Formulas
- **State variables**:
- \(Z = X\oplus Y\), where \(X\) and \(Y\) are binary variables with values in \(\{0, 1\}\).
- **Signal probabilities**:
- \(\Pr(s_i = X)=\frac{2}{3}\) for \(i\in\{1, 2, 3\}\)
- \(\Pr(s_i = Y)=\frac{2}{3}\) for \(i\in\{4, 5, 6\}\)
- **Payment rules**:
- In the observable - result setting:
\[
t_i(r)=\alpha\cdot(K - \varepsilon(r))
\]
- In the zero - sample setting:
\[
t_i(r)=\beta\cdot c(r)
\]
- **Welfare function**:
\[
E[W(x^*, s)]\geq(1 - \delta)E[W(x_{\text{opt}}, s)]
\]
where \(x_{\text{opt}}=\arg\max_{x\in X}W(x, s)\), \(W:X\times S\rightarrow\mathbb{R}\) is the welfare function, and \(\delta\in[0, 1)\) is a small positive number.
### Key Definitions
- **\(\delta\)-sufficient world model**:
- An LLM is considered a \(\delta\)-sufficient world model if for any true signal configuration \(s\in S\), the result \(x^*\) selected by the LLM satisfies:
\[
E[W(x^*, s)]\geq(1 - \delta)E[W(x_{\text{opt}}, s)]
\]
- **Inter - agent information over - determination condition**:
- The information structure satisfies the inter - agent information over - determination condition if for any agent \(i\) and any misreported \(r_i\neq s_i\), either:
- (Zero - sample setting) The LLM can detect with high probability that \(r_i\) is inconsistent with the true report \(s_{-i}\);
- (Observable - result setting) When replacing \(s_i\) with \(r_i\), the expected prediction error \(E[\varep\)