Abstract:In multiagent systems, social optimality is a desirable goal to achieve in terms of maximizing the global efficiency of the system. We study the problem of coordinating on socially optimal outcomes among a population of agents, in which each agent randomly interacts with another agent from the population each round. Previous work [Hales and Edmonds 2003; Matlock and Sen 2007, 2009] mainly resorts to modifying the interaction protocol from random interaction to tag-based interactions and only focus on the case of symmetric games. Besides, in previous work the agents’ decision making processes are usually based on evolutionary learning, which usually results in high communication cost and high deviation on the coordination rate. To solve these problems, we propose an alternative social learning framework with two major contributions as follows. First, we introduce the observation mechanism to reduce the amount of communication required among agents. Second, we propose that the agents’ learning strategies should be based on reinforcement learning technique instead of evolutionary learning. Each agent explicitly keeps the record of its current state in its learning strategy, and learn its optimal policy for each state independently. In this way, the learning performance is much more stable and also it is suitable for both symmetric and asymmetric games. The performance of this social learning framework is extensively evaluated under the testbed of two-player general-sum games comparing with previous work [Hao and Leung 2011; Matlock and Sen 2007]. The influences of different factors on the learning performance of the social learning framework are investigated as well.

Agent Adaptation through Social Opinion

Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learning

Learning enables adaptation in cooperation for multi-player stochastic games

A study on environmental adaptation and expansion of intelligent agent

Environment Support for Developing and Configuring Adaptive Agents

Dynamically Analyzing Cell Interactions in Biological Environments Using Multiagent Social Learning Framework

Adaptation in Online Social Learning

Improving the representation of smallholder farmers' adaptive behaviour in agent-based models: Learning-by-doing and social learning

Dynamic groups in complex task environments: To change or not to change a winning team?

Learning from Learners: Adapting Reinforcement Learning Agents to be Competitive in a Card Game

Achieving Socially Optimal Outcomes in Multiagent Systems with Reinforcement Social Learning

AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making

Collective Adaptation in Multi-Agent Systems: How Predator Confusion Shapes Swarm-Like Behaviors

Asymmetric Adaption in Social Learning: Understanding the Dilemma of Competition and Cooperation

Prediction and Adaptation in an Evolving Chaotic Environment

Adapting Behaviour Based On Trust In Human-Agent Ad Hoc Teamwork

Life, uh, Finds a Way: Systematic Neural Search

Modelling Adaptive Learning Behaviours for Consensus Formation in Human Societies

Understanding the World to Solve Social Dilemmas Using Multi-Agent Reinforcement Learning

A Multi-Agent Adaptive Co-Evolution Method in Dynamic Environments

Self-adaptation of multi-agent systems in dynamic environments based on experience exchanges.