Abstract:Multi-agent reinforcement learning shines as the pinnacle of multi-agent systems, conquering intricate real-world challenges, fostering collaboration and coordination among agents, and unleashing the potential for intelligent decision-making across domains. However, training a multi-agent reinforcement learning network is a formidable endeavor, demanding substantial computational resources to interact with diverse environmental variables, extract state representations, and acquire decision-making knowledge. The recent breakthroughs in large-scale pre-trained models ignite our curiosity: Can we uncover shared knowledge in multi-agent reinforcement learning and leverage pre-trained models to expedite training for future tasks? Addressing this issue, we present an innovative multi-task learning approach that aims to extract and harness common decision-making knowledge, like cooperation and competition, across different tasks. Our approach involves concurrent training of multiple multi-agent tasks, with each task employing independent front-end perception layers while sharing back-end decision-making layers. This effective decoupling of state representation extraction from decision-making allows for more efficient training and better transferability. To evaluate the efficacy of our proposed approach, we conduct comprehensive experiments in two distinct environments: the StarCraft Multi-agent Challenge (SMAC) and the Google Research Football (GRF) environments. The experimental results unequivocally demonstrate the smooth transferability of the shared decision-making network to other tasks, thereby significantly reducing training costs and improving final performance. Furthermore, visualizations authenticate the presence of general multi-agent decision-making knowledge within the shared network layers, further validating the effectiveness of our approach.

Parallel learner: A practical deep reinforcement learning framework for multi-scenario games

Deep reinforcement learning algorithm based on multi-agent parallelism and its application in game environment

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Enabling Multi-Agent Transfer Reinforcement Learning via Scenario Independent Representation

Parallel Curriculum Experience Replay in Distributed Reinforcement Learning.

Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning

A further exploration of deep Multi-Agent Reinforcement Learning with Hybrid Action Space

Parallel reinforcement learning: a framework and case study

Parallel Knowledge Transfer in Multi-Agent Reinforcement Learning

Multi-Task Reinforcement Learning in Continuous Control with Successor Feature-Based Concurrent Composition

Efficient Parallel Methods for Deep Reinforcement Learning

A TD3-based multi-agent deep reinforcement learning method in mixed cooperation-competition environment

On Multi-Agent Learning in Team Sports Games

Emergent Solutions to High-Dimensional Multitask Reinforcement Learning

MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning

The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

Distributed Deep Reinforcement Learning: A Survey and a Multi-player Multi-agent Learning Toolbox

Coach-Player Multi-Agent Reinforcement Learning for Dynamic Team Composition

Multi-Task Multi-Agent Shared Layers are Universal Cognition of Multi-Agent Coordination

Parallel Multi-Environment Shaping Algorithm for Complex Multi-step Task

Learning to Collaborate: Multi-Scenario Ranking Via Multi-Agent Reinforcement Learning.