Abstract:Multi-Agent Reinforcement Learning (MARL) is extensively utilized for addressing intricate tasks that involve cooperation and competition among agents in Multi-Agent Systems (MAS). However, learning such tasks from scratch is challenging and often unfeasible, especially for MASs with a large number of agents. Hence, leveraging knowledge from prior experiences can effectively expedite the MARL learning process. Prior work has shown that we successfully facilitated transfer learning for MARL by consolidating various state spaces into fixed-size inputs, enabling a single unified deep-learning policy applicable to several scenarios within the StarCraft Multi-Agent Challenge (SMAC) environment. In this study, we expand SMAC to Multi-Player enabled SMAC (MP-SMAC) by enabling the dynamic selection of training opponents and introducing a co-evolving MARL framework, which creates a co-evolutionary arena where multiple policies learn simultaneously. Our arena comprised the simultaneous training of multiple policies in diverse scenarios, pitting them against both static AI opponents and their peers within MP-SMAC. Furthermore, we integrate co-evolution with curriculum transfer learning into Co-MACTRL framework, enabling our MARL policies to systematically acquire knowledge and skills across predetermined scenarios organized by varying difficulty levels, including evolving opponents. The results revealed significant enhancements in MARL learning performance, demonstrating the advantage of leveraging the co-evolving opponents and maneuvering skills obtained from different scenarios. Additionally, the Co-MACTRL learners consistently attained high performance across a range of SMAC scenarios, showcasing the robustness and generalizability of Co-MACTRL.

Efficient Multi-Agent Exploration with Mutual-Guided Actor-Critic

A Graph-Based Soft Actor Critic Approach in Multi-Agent Reinforcement Learning

Cooperative multi-agent game based on reinforcement learning

Value-Decomposition Multi-Agent Actor-Critics

Self-Motivated Multi-Agent Exploration

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

Decomposed Soft Actor-Critic Method for Cooperative Multi-Agent Reinforcement Learning

Modeling the Interaction Between Agents in Cooperative Multi-Agent Reinforcement Learning

Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments

Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?

Continuous Self-Adaptive Optimization to Learn Multi-Task Multi-Agent

ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency

Co-Evolving Multi-Agent Transfer Reinforcement Learning Via Scenario Independent Representation

SC-MAIRL: Semi-Centralized Multi-Agent Imitation Reinforcement Learning

SVDE: Scalable Value-Decomposition Exploration for Cooperative Multi-Agent Reinforcement Learning

Revisiting Some Common Practices in Cooperative Multi-Agent Reinforcement Learning

APC: Predict Global Representation from Local Observation in Multi-Agent Reinforcement Learning

Episodic Multi-agent Reinforcement Learning with Curiosity-driven Exploration

MuDE: Multi-agent decomposed reward-based exploration

Enhancing Robustness in Multi-Agent Actor-Critic with Double Actors

Priority over Quantity: A Self-Incentive Credit Assignment Scheme for Cooperative Multiagent Reinforcement Learning