Abstract:In recent years, cooperative Multi-Agent Deep Reinforcement Learning (MADRL) has received increasing research interest and has been widely applied to computer games and coordinated multi-robot systems, etc. However, it is still challenging to realize high solution quality and learning efficiency for MADRL under the conditions of incomplete and noisy observations. To this end, this paper proposes a multi-agent deep reinforcement learning approach with Grouped Cognitive featurE representatioN (GCEN), following the paradigm of Centralized Training and Decentralized Execution (CTDE). Different from previous works, GCEN incorporates a new grouped cognitive feature representation that combines a grouped attention mechanism and a training approach using mutual information. The grouped attention mechanism is proposed to selectively extract entity features within the observation field for each agent while avoiding the influence of irrelevant observations. The mutual information regularization term is designed to guide the agents to learn grouped cognitive features based on global information, aiming to mitigate the influence of partial observations. The proposed GCEN approach can be extended as a feature representation module to different MADRL methods. Extensive experiments on the challenging level-based foraging and StarCraft II micromanagement benchmarks were conducted to illustrate the effectiveness and advantages of the proposed approach. Compared with seven representative MADRL algorithms, our proposed approach achieves state-of-the-art performance in winning rates and training efficiency. Experiments results further demonstrate that GCEN has improved generalization ability across varying sight ranges.

Consciousness-Aware Multi-Agent Reinforcement Learning

Complementary Attention for Multi-Agent Reinforcement Learning.

S2rl

Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?

Qatten: A General Framework for Cooperative Multiagent Reinforcement Learning

CTDS: Centralized Teacher with Decentralized Student for Multi-Agent Reinforcement Learning

GCEN: Multiagent Deep Reinforcement Learning with Grouped Cognitive Feature Representation

Enhancing cooperation by cognition differences and consistent representation in multi-agent reinforcement learning

Multiagent Q-learning with Sub-Team Coordination.

Attention Enhanced Reinforcement Learning for Multi agent Cooperation

Cooperative multi-agent game based on reinforcement learning

Neighborhood Curiosity-Based Exploration in Multi-Agent Reinforcement Learning

Multi-Agent Concentrative Coordination with Decentralized Task Representation

Hierarchical Consensus-Based Multi-Agent Reinforcement Learning for Multi-Robot Cooperation Tasks

ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency

Optimistic sequential multi-agent reinforcement learning with motivational communication

Self-Motivated Multi-Agent Exploration

Learning Controlled and Targeted Communication with the Centralized Critic for the Multi-Agent System.

Coordination as inference in multi-agent reinforcement learning

Attentive Relational State Representation in Decentralized Multiagent Reinforcement Learning.

Multi-agent Continual Coordination Via Progressive Task Contextualization