Abstract:Multi-Agent Reinforcement Learning (MARL) is widely used to solve various real-world prob-lems. In MARL, the environment contains multiple agents. A good grasp of the environment can guide agents to learn cooperative strategies. In Centralized Training Decentralized Execution (CTDE), a centralized critic is used to guide cooperative strategies learning. However, having mul-tiple agents in the environment leads to the curse of dimensionality and influence of other agents' strategies, resulting in difficulties for centralized critics to learn good cooperative strategies. We propose a graph-based approach to overcome the above problems. It uses a graph neural network, which uses partial observations of agents as input, and information between agents is aggregated by graph methods to extract information about the whole environment. In this way, agents can improve their understanding of the overall state of the environment and other agents in the environ-ment while avoiding dimensional explosion. Then we combine a dual critic dynamic decomposition method with soft actor-critic to train policy. The former uses individual and global rewards for learning, avoiding the influence of other agents' strategies, and the latter help to learn an optional policy better. We call this approach Multi-Agent Graph-based soft Actor-Critic (MAGAC). We compare our proposed method with several classical MARL algorithms under the Multi-agent Par-ticle Environment (MPE). The experimental results show that our method can achieve a faster learning speed while learning better policy.

Attention-Guided Contrastive Role Representations for Multi-Agent Reinforcement Learning

S2rl

S2RL: Do We Really Need to Perceive All States in Deep Multi-Agent Reinforcement Learning?

S2RL: DoWe Really Need to Perceive All States in Deep Multi-Agent Reinforcement Learning?

ROMA: Multi-Agent Reinforcement Learning with Emergent Roles

Multi-Agent Self-Motivated Learning Via Role Representation

A Graph-Based Soft Actor Critic Approach in Multi-Agent Reinforcement Learning

Attentive Relational State Representation in Decentralized Multiagent Reinforcement Learning.

MA2CL:Masked Attentive Contrastive Learning for Multi-Agent Reinforcement Learning

A Contrastive-Enhanced Ensemble Framework for Efficient Multi-Agent Reinforcement Learning

Multiagent Reinforcement Learning With Heterogeneous Graph Attention Network

Multi-agent Continual Coordination Via Progressive Task Contextualization

Multiagent Continual Coordination via Progressive Task Contextualization

Group-Aware Coordination Graph for Multi-Agent Reinforcement Learning

A Cooperative Multi-Agent Reinforcement Learning Method Based on Coordination Degree

RODE: Learning Roles to Decompose Multi-Agent Tasks

Effective and Stable Role-Based Multi-Agent Collaboration by Structural Information Principles

Relation-Aware Learning for Multi-Task Multi-Agent Cooperative Games

Multi-Agent Concentrative Coordination with Decentralized Task Representation

Cooperative multi-agent game based on reinforcement learning

Contrastive learning-based agent modeling for deep reinforcement learning