Abstract:Multi-agent reinforcement learning shines as the pinnacle of multi-agent systems, conquering intricate real-world challenges, fostering collaboration and coordination among agents, and unleashing the potential for intelligent decision-making across domains. However, training a multi-agent reinforcement learning network is a formidable endeavor, demanding substantial computational resources to interact with diverse environmental variables, extract state representations, and acquire decision-making knowledge. The recent breakthroughs in large-scale pre-trained models ignite our curiosity: Can we uncover shared knowledge in multi-agent reinforcement learning and leverage pre-trained models to expedite training for future tasks? Addressing this issue, we present an innovative multi-task learning approach that aims to extract and harness common decision-making knowledge, like cooperation and competition, across different tasks. Our approach involves concurrent training of multiple multi-agent tasks, with each task employing independent front-end perception layers while sharing back-end decision-making layers. This effective decoupling of state representation extraction from decision-making allows for more efficient training and better transferability. To evaluate the efficacy of our proposed approach, we conduct comprehensive experiments in two distinct environments: the StarCraft Multi-agent Challenge (SMAC) and the Google Research Football (GRF) environments. The experimental results unequivocally demonstrate the smooth transferability of the shared decision-making network to other tasks, thereby significantly reducing training costs and improving final performance. Furthermore, visualizations authenticate the presence of general multi-agent decision-making knowledge within the shared network layers, further validating the effectiveness of our approach.

Decomposing Shared Networks for Separate Cooperation with Multi-Agent Reinforcement Learning

Learning Intra-group Cooperation in Multi-agent Systems.

C^2:Co-design of Robots via Concurrent Networks Coupling Online and Offline Reinforcement Learning

C2: Co-design of Robots Via Concurrent-Network Coupling Online and Offline Reinforcement Learning

Expert demonstrations guide reward decomposition for multi-agent cooperation

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Coordinating Multi-Agent Reinforcement Learning Via Dual Collaborative Constraints

Multi-Task Multi-Agent Shared Layers are Universal Cognition of Multi-Agent Coordination

Value-Decomposition Networks For Cooperative Multi-Agent Learning

Value-Decomposition Networks For Cooperative Multi-Agent Learning Based On Team Reward

CCNet : Cluster-Coordinated Net for Learning Multi-agent Communication Protocols with Reinforcement Learning

Hierarchical Reinforcement Learning with Opponent Modeling for Distributed Multi-agent Cooperation

ADMN: Agent-Driven Modular Network for Dynamic Parameter Sharing in Cooperative Multi-Agent Reinforcement Learning

Learning to Share in Multi-Agent Reinforcement Learning

A Privacy-preserving Distributed Training Framework for Cooperative Multi-agent Deep Reinforcement Learning

Enhancing cooperation by cognition differences and consistent representation in multi-agent reinforcement learning

A Cooperation Graph Approach for Multiagent Sparse Reward Reinforcement Learning

AVD-Net: Attention Value Decomposition Network for Deep Multi-Agent Reinforcement Learning

FCMNet: Full Communication Memory Net for Team-Level Cooperation in Multi-Agent Systems

Cooperative Policy Learning with Pre-trained Heterogeneous Observation Representations

Learning Group-Level Information Integration in Multi-Agent Communication