Abstract:In multiagent systems, social optimality is a desirable goal to achieve in terms of maximizing the global efficiency of the system. We study the problem of coordinating on socially optimal outcomes among a population of agents, in which each agent randomly interacts with another agent from the population each round. Previous work [Hales and Edmonds 2003; Matlock and Sen 2007, 2009] mainly resorts to modifying the interaction protocol from random interaction to tag-based interactions and only focus on the case of symmetric games. Besides, in previous work the agents’ decision making processes are usually based on evolutionary learning, which usually results in high communication cost and high deviation on the coordination rate. To solve these problems, we propose an alternative social learning framework with two major contributions as follows. First, we introduce the observation mechanism to reduce the amount of communication required among agents. Second, we propose that the agents’ learning strategies should be based on reinforcement learning technique instead of evolutionary learning. Each agent explicitly keeps the record of its current state in its learning strategy, and learn its optimal policy for each state independently. In this way, the learning performance is much more stable and also it is suitable for both symmetric and asymmetric games. The performance of this social learning framework is extensively evaluated under the testbed of two-player general-sum games comparing with previous work [Hao and Leung 2011; Matlock and Sen 2007]. The influences of different factors on the learning performance of the social learning framework are investigated as well.

A Game-Theoretic Learning Model in Multi-Agent Systems

Adaptive algorithm for multi-agent learning optimal cooperative pursuit strategy based on Markov game

Dynamic channel selection in unknown environment based on graphical game and multi-Q learning

Learning Intra-group Cooperation in Multi-agent Systems.

A Game-Theoretic Learning Framework for Multi-Agent Intelligent Wireless Networks

Non-cooperative Multi-agent Systems with Exploring Agents

A novel multi-agent Q-learning algorithm in cooperative multi-agent system

Mathematics of multi-agent learning systems at the interface of game theory and artificial intelligence

A Multi-Agent Reinforcement Learning Algorithm Based on Stackelberg Game

Modeling Decision Process in Multi-Agent Systems: A Graphical Markov Game Based Approach

A Two-Layered Multi-Agent Reinforcement Learning Model and Algorithm

Learning Methodologies for Wireless Big Data Networks: A Markovian Game-Theoretic Perspective.

Meta-game equilibrium for multi-agent reinforcement learning

LMRL: a Multi-Agent Reinforcement Learning Model and Algorithm

Learning in Multiagent Systems: An Introduction from a Game-Theoretic Perspective

A Black-box Approach for Non-stationary Multi-agent Reinforcement Learning

Survey of Multi-agent Reinforcement Learning in Markov Games

The Confluence of Networks, Games and Learning

A new multi-agent reinforcement learning approach

The Dynamics of Reinforcement Social Learning in Networked Cooperative Multiagent Systems

Achieving Socially Optimal Outcomes in Multiagent Systems with Reinforcement Social Learning