Abstract:In multiagent systems, social optimality is a desirable goal to achieve in terms of maximizing the global efficiency of the system. We study the problem of coordinating on socially optimal outcomes among a population of agents, in which each agent randomly interacts with another agent from the population each round. Previous work [Hales and Edmonds 2003; Matlock and Sen 2007, 2009] mainly resorts to modifying the interaction protocol from random interaction to tag-based interactions and only focus on the case of symmetric games. Besides, in previous work the agents’ decision making processes are usually based on evolutionary learning, which usually results in high communication cost and high deviation on the coordination rate. To solve these problems, we propose an alternative social learning framework with two major contributions as follows. First, we introduce the observation mechanism to reduce the amount of communication required among agents. Second, we propose that the agents’ learning strategies should be based on reinforcement learning technique instead of evolutionary learning. Each agent explicitly keeps the record of its current state in its learning strategy, and learn its optimal policy for each state independently. In this way, the learning performance is much more stable and also it is suitable for both symmetric and asymmetric games. The performance of this social learning framework is extensively evaluated under the testbed of two-player general-sum games comparing with previous work [Hao and Leung 2011; Matlock and Sen 2007]. The influences of different factors on the learning performance of the social learning framework are investigated as well.

Social Learning Methods in Board Games

Reciprocal Social Strategy in Social Repeated Games.

Reciprocal Social Strategy in Social Repeated Games and Emergence of Social Norms.

How game complexity affects the playing behavior of synthetic agents

Social Interaction for Efficient Agent Learning from Human Reward.

Achieving Socially Optimal Outcomes in Multiagent Systems with Reinforcement Social Learning

Social learning spontaneously emerges by searching optimal heuristics with deep reinforcement learning

Learning from Learners: Adapting Reinforcement Learning Agents to be Competitive in a Card Game

Multi-agent Reinforcement Learning in Sequential Social Dilemmas

Incorporating Social Payoff into Reinforcement Learning Promotes Cooperation

Learning to Achieve Social Rationality Using Tag Mechanism in Repeated Interactions

Emergent Social Learning via Multi-agent Reinforcement Learning

Learning from Human Reward Benefits from Socio-Competitive Feedback

Neural Auto-Curricula in Two-Player Zero-Sum Games.

Learning by Co-Designing a Board Game to Make Chain Store Knowledge More Robust

Neural Auto-Curricula

Interaction state Q-learning promotes cooperation in the spatial prisoner's dilemma game

AGB stars in extragalactic systems

Socially-Aware Multiagent Learning: Towards Socially Optimal Outcomes.

A Generalized Training Approach for Multiagent Learning

Evaluation and Learning in Two-Player Symmetric Games via Best and Better Responses