Abstract:Multi-Agent Reinforcement Learning (MARL) is extensively utilized for addressing intricate tasks that involve cooperation and competition among agents in Multi-Agent Systems (MAS). However, learning such tasks from scratch is challenging and often unfeasible, especially for MASs with a large number of agents. Hence, leveraging knowledge from prior experiences can effectively expedite the MARL learning process. Prior work has shown that we successfully facilitated transfer learning for MARL by consolidating various state spaces into fixed-size inputs, enabling a single unified deep-learning policy applicable to several scenarios within the StarCraft Multi-Agent Challenge (SMAC) environment. In this study, we expand SMAC to Multi-Player enabled SMAC (MP-SMAC) by enabling the dynamic selection of training opponents and introducing a co-evolving MARL framework, which creates a co-evolutionary arena where multiple policies learn simultaneously. Our arena comprised the simultaneous training of multiple policies in diverse scenarios, pitting them against both static AI opponents and their peers within MP-SMAC. Furthermore, we integrate co-evolution with curriculum transfer learning into Co-MACTRL framework, enabling our MARL policies to systematically acquire knowledge and skills across predetermined scenarios organized by varying difficulty levels, including evolving opponents. The results revealed significant enhancements in MARL learning performance, demonstrating the advantage of leveraging the co-evolving opponents and maneuvering skills obtained from different scenarios. Additionally, the Co-MACTRL learners consistently attained high performance across a range of SMAC scenarios, showcasing the robustness and generalizability of Co-MACTRL.

Relation-Aware Learning for Multi-Task Multi-Agent Cooperative Games

Learning Intra-group Cooperation in Multi-agent Systems.

LDSA: Learning Dynamic Subtask Assignment in Cooperative Multi-Agent Reinforcement Learning

Hierarchical relationship modeling in multi-agent reinforcement learning for mixed cooperative–competitive environments

Multi-Agent Cooperation via Unsupervised Learning of Joint Intentions

Enhancing cooperation by cognition differences and consistent representation in multi-agent reinforcement learning

A Cooperative Multi-Agent Reinforcement Learning Method Based on Coordination Degree

Multi-Agent Evolutionary Reinforcement Learning Based on Cooperative Games

Attention-Guided Contrastive Role Representations for Multi-Agent Reinforcement Learning

Coordinating Multi-Agent Reinforcement Learning Via Dual Collaborative Constraints

Reinforcement learning for encouraging cooperation in a multiagent system

Coordination Between Individual Agents in Multi-Agent Reinforcement Learning.

Learning Multi-Agent Cooperation via Considering Actions of Teammates

A new multi-agent reinforcement learning approach

Qatten: A General Framework for Cooperative Multiagent Reinforcement Learning

Curriculum Learning for Cooperation in Multi-Agent Reinforcement Learning

Commander-Soldiers Reinforcement Learning for Cooperative Multi-Agent Systems

Co-Evolving Multi-Agent Transfer Reinforcement Learning Via Scenario Independent Representation

Reinforcement Learning with Task Decomposition for Cooperative Multiagent Systems.

A Novel Multi-Agent Reinforcement Learning Approach

Situation-Dependent Causal Influence-Based Cooperative Multi-agent Reinforcement Learning