Abstract:People are often reluctant to incorporate information produced by algorithms into their decisions, a phenomenon called ``algorithm aversion''. This paper shows how algorithm aversion arises when the choice to follow an algorithm conveys information about a human's ability. I develop a model in which workers make forecasts of an uncertain outcome based on their own private information and an algorithm's signal. Low-skill workers receive worse information than the algorithm and hence should always follow the algorithm's signal, while high-skill workers receive better information than the algorithm and should sometimes override it. However, due to reputational concerns, low-skill workers inefficiently override the algorithm to increase the likelihood they are perceived as high-skill. The model provides a fully rational microfoundation for algorithm aversion that aligns with the broad concern that AI systems will displace many types of workers.
Theoretical Economics,Artificial Intelligence,Computer Science and Game Theory,Human-Computer Interaction
What problem does this paper attempt to address?
### Problems Addressed by the Paper
This paper explores the phenomenon of algorithm aversion, where people often hesitate to adopt information provided by algorithms when making decisions. Specifically, the authors construct a model to explain why low-skilled workers sometimes go against algorithmic recommendations, even when such actions are inefficient. The core of the model is that workers' choices to follow or defy the algorithm may convey information about their abilities, thereby affecting their reputation.
### Main Contributions
1. **Rational Microfoundation**: The paper provides a fully rational microfoundation to explain the phenomenon of algorithm aversion, aligning with widespread concerns that AI systems will replace many types of jobs.
2. **Model Mechanism**: Through a strategic communication model (cheap talk game), the authors demonstrate that low-skilled workers sometimes defy algorithmic recommendations to maintain their reputation, even if this reduces overall predictive accuracy.
3. **Empirical Consistency**: The model's predictions align with a large body of empirical evidence, such as the fact that human predictions remain less accurate than the algorithm's even after receiving algorithmic advice.
### Key Assumptions and Conclusions
- **Assumptions**:
- Workers are categorized into high-skilled and low-skilled types. High-skilled workers' information is always more accurate than the algorithm, while low-skilled workers' information is less accurate.
- Managers update their beliefs about workers' skills based on their predictive results.
- Workers have reputational concerns and want managers to perceive them as high-skilled.
- **Conclusions**:
- In the absence of an algorithm, there exists an efficient equilibrium where workers truthfully report their signals.
- With the introduction of an algorithm, low-skilled workers sometimes defy the algorithm due to reputational concerns, even though this is inefficient.
- As the uncertainty of the algorithm increases, algorithm aversion also intensifies because the algorithm's signals become less accurate, leading low-skilled workers to defy the algorithm more frequently to showcase their abilities.
### Practical Applications
- **Labor Market Impact**: Algorithm aversion may lead to a decrease in workers' predictive accuracy, potentially resulting in zero value for the company in some cases, which could negatively impact workers' wages and employment.
- **Corporate Decision-Making**: If the costs of retaining and training employees are high and the company has high future revenue expectations, algorithm aversion might lead to the complete dismissal of employees.
### Theoretical Contributions
- **Reputation Theory**: The paper integrates the frameworks of cheap talk and career concerns, showing how workers strategically report predictions to maximize positive evaluations of their skills by managers.
- **Model Differences**: Unlike traditional reputation cheap talk models, workers in this paper know their type and receive both private and public signals (algorithm), making their predictions also convey information about their abilities.
In summary, this paper rigorously explains the phenomenon of algorithm aversion through a model, providing theoretical and empirical support and offering new perspectives on the obstacles to human-AI system collaboration.