Abstract:Recent developments in reinforcement learning have been able to derive optimal policies for sophisticated and capable agents, and shown to achieve human-level performance on a number of challenging tasks. Unfortunately, when it comes to multi-agent systems (MASs), complexities such as non-stationarity and partial observability bring new challenges to the field. Building a flexible and efficient multi-agent reinforcement learning algorithm capable of handling complex tasks has to date remained an open challenge. This paper presents an Multi-Agent learning system with the evolution of Social Roles (eSRMA). The main interest is placed on solving the key issues in the definition and evolution of suitable roles, and optimizing the policies accompanied by social roles in MAS efficiently. Specifically, eSRMA incorporates and cultivates role division awareness of agents to improve the ability to deal with complex cooperative tasks. Each agent is assigned a role module, which can dynamically generate roles based on the individuals’ local observations. A novel multi-agent reinforcement learning algorithm (MARL) is designed as the principal driving force that governs the role-policy learning process by a role-attention credit assignment mechanism. Moreover, a role evolution process is developed to help agents dynamically choose appropriate roles in decision-making. Comprehensive experiments on the StarCraft II micromanagement benchmark have demonstrated that eSRMA exhibits superiority in achieving higher learning capability and efficiency for multiple agents compared to the state-of-the-art MARL methods.

Commander-Soldiers Reinforcement Learning for Cooperative Multi-Agent Systems

S2rl

Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?

Coach-Player Multi-Agent Reinforcement Learning for Dynamic Team Composition

StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer Learning

Enhancing Multi-Agent Coordination through Common Operating Picture Integration

Hierarchical Cooperative Multi-Agent Reinforcement Learning with Skill Discovery

A Multi-agent Cooperative Learning System with Evolution of Social Roles

A Multiagent Cooperative Learning System with Evolution of Social Roles

Multi-agent Cooperative Combat Simulation in Naval Battlefield with Reinforcement Learning

Towards Distributed Communication and Control in Real-World Multi-Agent Reinforcement Learning

Enhancing cooperation by cognition differences and consistent representation in multi-agent reinforcement learning

Relation-Aware Learning for Multi-Task Multi-Agent Cooperative Games

SC-MAIRL: Semi-Centralized Multi-Agent Imitation Reinforcement Learning

Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Games

Self-Motivated Multi-Agent Exploration

Collaboration of AI Agents via Cooperative Multi-Agent Deep Reinforcement Learning

Consciousness-Aware Multi-Agent Reinforcement Learning

Innate-Values-driven Reinforcement Learning for Cooperative Multi-Agent Systems

Hierarchical Reinforcement Learning for Multi-agent MOBA Game

Signal Instructed Coordination in Cooperative Multi-agent Reinforcement Learning