Abstract:Multi-Agent Reinforcement Learning (MARL) is extensively utilized for addressing intricate tasks that involve cooperation and competition among agents in Multi-Agent Systems (MAS). However, learning such tasks from scratch is challenging and often unfeasible, especially for MASs with a large number of agents. Hence, leveraging knowledge from prior experiences can effectively expedite the MARL learning process. Prior work has shown that we successfully facilitated transfer learning for MARL by consolidating various state spaces into fixed-size inputs, enabling a single unified deep-learning policy applicable to several scenarios within the StarCraft Multi-Agent Challenge (SMAC) environment. In this study, we expand SMAC to Multi-Player enabled SMAC (MP-SMAC) by enabling the dynamic selection of training opponents and introducing a co-evolving MARL framework, which creates a co-evolutionary arena where multiple policies learn simultaneously. Our arena comprised the simultaneous training of multiple policies in diverse scenarios, pitting them against both static AI opponents and their peers within MP-SMAC. Furthermore, we integrate co-evolution with curriculum transfer learning into Co-MACTRL framework, enabling our MARL policies to systematically acquire knowledge and skills across predetermined scenarios organized by varying difficulty levels, including evolving opponents. The results revealed significant enhancements in MARL learning performance, demonstrating the advantage of leveraging the co-evolving opponents and maneuvering skills obtained from different scenarios. Additionally, the Co-MACTRL learners consistently attained high performance across a range of SMAC scenarios, showcasing the robustness and generalizability of Co-MACTRL.

A Distributed Simulation-to-Reality Transfer Framework for Multi-agent Reinforcement Learning

Observer-Based Multiagent Deep Reinforcement Learning: A Fully Distributed Training Scheme

MARL Sim2real Transfer: Merging Physical Reality With Digital Virtuality in Metaverse

A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer towards Autonomous Driving

A Scalable and Parallelizable Digital Twin Framework for Sustainable Sim2Real Transition of Multi-Agent Reinforcement Learning Systems

Enabling Multi-Agent Transfer Reinforcement Learning via Scenario Independent Representation

Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learning

Transfer Learning in Multi-Agent Reinforcement Learning with Double Q-Networks for Distributed Resource Sharing in V2X Communication

Federated Transfer Reinforcement Learning for Autonomous Driving

Sim-to-Real Transfer of Deep Reinforcement Learning Agents for Online Coverage Path Planning

A Transfer Learning Framework for Deep Multi-Agent Reinforcement Learning

Multi-agent Cooperative Combat Simulation in Naval Battlefield with Reinforcement Learning

Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey

From Multi-agent to Multi-robot: A Scalable Training and Evaluation Platform for Multi-robot Reinforcement Learning

Low-Cost Multi-Agent Navigation Via Reinforcement Learning with Multi-Fidelity Simulator.

Accelerating Multiagent Reinforcement Learning by Equilibrium Transfer

Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL

Towards Distributed Communication and Control in Real-World Multi-Agent Reinforcement Learning

Learning when to Transfer among Agents: an Efficient Multiagent Transfer Learning Framework.

A novel simulation reality closed loop learning framework for autonomous robot skill learning

Co-Evolving Multi-Agent Transfer Reinforcement Learning Via Scenario Independent Representation