Abstract:Recent developments in reinforcement learning have been able to derive optimal policies for sophisticated and capable agents, and shown to achieve human-level performance on a number of challenging tasks. Unfortunately, when it comes to multi-agent systems (MASs), complexities such as non-stationarity and partial observability bring new challenges to the field. Building a flexible and efficient multi-agent reinforcement learning algorithm capable of handling complex tasks has to date remained an open challenge. This paper presents an Multi-Agent learning system with the evolution of Social Roles (eSRMA). The main interest is placed on solving the key issues in the definition and evolution of suitable roles, and optimizing the policies accompanied by social roles in MAS efficiently. Specifically, eSRMA incorporates and cultivates role division awareness of agents to improve the ability to deal with complex cooperative tasks. Each agent is assigned a role module, which can dynamically generate roles based on the individuals’ local observations. A novel multi-agent reinforcement learning algorithm (MARL) is designed as the principal driving force that governs the role-policy learning process by a role-attention credit assignment mechanism. Moreover, a role evolution process is developed to help agents dynamically choose appropriate roles in decision-making. Comprehensive experiments on the StarCraft II micromanagement benchmark have demonstrated that eSRMA exhibits superiority in achieving higher learning capability and efficiency for multiple agents compared to the state-of-the-art MARL methods.

The Multi-Agent System Based on Reinforcement Learning

Multi-Agent Reinforcement Learning Control for Consensus Problems of Uncertain Nonlinear Multi-Agent Systems

Observer-Based Multiagent Deep Reinforcement Learning: A Fully Distributed Training Scheme

LMRL: a Multi-Agent Reinforcement Learning Model and Algorithm

Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning

A multiagent reinforcement learning approach based on different states

A Two-Layered Multi-Agent Reinforcement Learning Model and Algorithm

Multi-Agent Deep Reinforcement Learning with Human Strategies

Evolutionary reinforcement learning algorithm for large-scale multi-agent cooperation and confrontation applications

A survey on multi-agent deep reinforcement learning: from the perspective of challenges and applications

Multi-Agent Cooperative Reinforcement Learning in 3d Virtual World

A Multi-agent Cooperative Learning System with Evolution of Social Roles

Deep reinforcement learning algorithm based on multi-agent parallelism and its application in game environment

Intention Propagation for Multi-agent Reinforcement Learning

Individual Reward Assisted Multi-Agent Reinforcement Learning.

Reinforcement learning for encouraging cooperation in a multiagent system

Multi-Agent Exploration Via Self-Learning and Social Learning

Overview on reinforcement learning of multi-agent game

A TD3-based multi-agent deep reinforcement learning method in mixed cooperation-competition environment

Multi-Agent Reinforcement Learning with Optimal Equivalent Action of Neighborhood

Deep Reinforcement Learning for Multi-Agent Interaction