Multi-Agent, Human-Agent and Beyond: A Survey on Cooperation in Social Dilemmas

Chunjiang Mu,Hao Guo,Yang Chen,Chen Shen,Shuyue Hu,Zhen Wang

2024-07-30

Abstract:The study of cooperation within social dilemmas has long been a fundamental topic across various disciplines, including computer science and social science. Recent advancements in Artificial Intelligence (AI) have significantly reshaped this field, offering fresh insights into understanding and enhancing cooperation. This survey examines three key areas at the intersection of AI and cooperation in social dilemmas. First, focusing on multi-agent cooperation, we review the intrinsic and external motivations that support cooperation among rational agents, and the methods employed to develop effective strategies against diverse opponents. Second, looking into human-agent cooperation, we discuss the current AI algorithms for cooperating with humans and the human biases towards AI agents. Third, we review the emergent field of leveraging AI agents to enhance cooperation among humans. We conclude by discussing future research avenues, such as using large language models, establishing unified theoretical frameworks, revisiting existing theories of human cooperation, and exploring multiple real-world applications.

Artificial Intelligence,Computer Science and Game Theory,Human-Computer Interaction,Machine Learning,Multiagent Systems

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to explore various aspects of cooperation in Social Dilemmas (SDs), particularly in the fields of Multi-Agent Systems (MAS), Human-Agent Cooperation (HAC), and the use of AI to promote human cooperation. Specifically, the paper focuses on the following issues:

1. **Multi-Agent Cooperation**:
- **Intrinsic and Extrinsic Motivation**: How to promote cooperation among multiple agents by designing appropriate intrinsic and extrinsic motivations?
- **Strategy Development**: How to develop effective cooperation strategies when facing different opponents?

2. **Human-Agent Cooperation**:
- **Algorithm Design**: How to design AI algorithms that enable agents to cooperate effectively with humans in social dilemmas?
- **Human Bias**: How to identify and mitigate human biases against AI agents?

3. **Using AI to Promote Human Cooperation**:
- **Recommendation Systems**: How can AI promote human cooperation through methods such as recommending partner selections?
- **Hybrid Systems**: How can human-agent hybrid systems achieve higher levels of cooperation with the support of evolutionary game theory?

### Background and Significance

Social dilemmas are widespread in various fields, such as environmental protection, public health crises, and resource management. These dilemmas typically manifest as conflicts between individual interests and collective interests. Although cooperation is beneficial to the collective, individuals often tend to exploit or free-ride, which can lead to the tragedy of the commons. Traditional research has revealed the key roles of reciprocity, social preferences, and communication in promoting human cooperation. However, with the development of Artificial Intelligence (AI), research in this field is undergoing profound changes.

### Main Contributions

1. **Comprehensive Review**: This paper provides the first comprehensive review of the latest advancements in AI for multi-agent cooperation, human-agent cooperation, and using AI to promote human cooperation.
2. **Future Research Directions**: It proposes future research directions, including the use of large language models, establishing a unified theoretical framework, re-examining existing human cooperation theories, and exploring various practical application scenarios.

### Conclusion

By comprehensively analyzing the latest research on multi-agent cooperation, human-agent cooperation, and using AI to promote human cooperation, this paper not only reflects the current state of research but also provides directions for future in-depth studies. As AI applications in human society become increasingly widespread, strengthening research on cooperative AI is particularly important.