Abstract:Recent developments in reinforcement learning have been able to derive optimal policies for sophisticated and capable agents, and shown to achieve human-level performance on a number of challenging tasks. Unfortunately, when it comes to multi-agent systems (MASs), complexities such as non-stationarity and partial observability bring new challenges to the field. Building a flexible and efficient multi-agent reinforcement learning algorithm capable of handling complex tasks has to date remained an open challenge. This paper presents an Multi-Agent learning system with the evolution of Social Roles (eSRMA). The main interest is placed on solving the key issues in the definition and evolution of suitable roles, and optimizing the policies accompanied by social roles in MAS efficiently. Specifically, eSRMA incorporates and cultivates role division awareness of agents to improve the ability to deal with complex cooperative tasks. Each agent is assigned a role module, which can dynamically generate roles based on the individuals’ local observations. A novel multi-agent reinforcement learning algorithm (MARL) is designed as the principal driving force that governs the role-policy learning process by a role-attention credit assignment mechanism. Moreover, a role evolution process is developed to help agents dynamically choose appropriate roles in decision-making. Comprehensive experiments on the StarCraft II micromanagement benchmark have demonstrated that eSRMA exhibits superiority in achieving higher learning capability and efficiency for multiple agents compared to the state-of-the-art MARL methods.

Emergent Social Learning via Multi-agent Reinforcement Learning

Evolutionary Multi-agent Reinforcement Learning in Group Social Dilemmas

Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning

Multi-Agent Evolutionary Reinforcement Learning Based on Cooperative Games

A Multiagent Cooperative Learning System with Evolution of Social Roles

A Multi-agent Cooperative Learning System with Evolution of Social Roles

Multi-Agent Exploration Via Self-Learning and Social Learning

Multi-agent cooperation through learning-aware policy gradients

Social learning spontaneously emerges by searching optimal heuristics with deep reinforcement learning

Emergent Dominance Hierarchies in Reinforcement Learning Agents

Understanding the World to Solve Social Dilemmas Using Multi-Agent Reinforcement Learning

Multi-agent Off-policy Actor-Critic Reinforcement Learning for Partially Observable Environments

Learning Emergence of Interaction Patterns across Independent RL Agents in Multi-Agent Environments

Deep multiagent reinforcement learning: challenges and directions

Robust Multi-Agent Reinforcement Learning with Social Empowerment for Coordination and Communication

LMRL: a Multi-Agent Reinforcement Learning Model and Algorithm

Multi-Agent Reinforcement Learning: A Report on Challenges and Approaches

A Two-Layered Multi-Agent Reinforcement Learning Model and Algorithm

Socialized Learning: Making Each Other Better Through Multi-Agent Collaboration

A New Multi-Agent Reinforcement Learning Method Based on Evolving Dynamic Correlation Matrix

Neural Learning for the Emergence of Social Norms in Multiagent Systems