Abstract:Multi-agent reinforcement learning shines as the pinnacle of multi-agent systems, conquering intricate real-world challenges, fostering collaboration and coordination among agents, and unleashing the potential for intelligent decision-making across domains. However, training a multi-agent reinforcement learning network is a formidable endeavor, demanding substantial computational resources to interact with diverse environmental variables, extract state representations, and acquire decision-making knowledge. The recent breakthroughs in large-scale pre-trained models ignite our curiosity: Can we uncover shared knowledge in multi-agent reinforcement learning and leverage pre-trained models to expedite training for future tasks? Addressing this issue, we present an innovative multi-task learning approach that aims to extract and harness common decision-making knowledge, like cooperation and competition, across different tasks. Our approach involves concurrent training of multiple multi-agent tasks, with each task employing independent front-end perception layers while sharing back-end decision-making layers. This effective decoupling of state representation extraction from decision-making allows for more efficient training and better transferability. To evaluate the efficacy of our proposed approach, we conduct comprehensive experiments in two distinct environments: the StarCraft Multi-agent Challenge (SMAC) and the Google Research Football (GRF) environments. The experimental results unequivocally demonstrate the smooth transferability of the shared decision-making network to other tasks, thereby significantly reducing training costs and improving final performance. Furthermore, visualizations authenticate the presence of general multi-agent decision-making knowledge within the shared network layers, further validating the effectiveness of our approach.

Deep Multi-Task Learning with Shared Memory

Deep Multi-Task Learning with Shared Memory for Text Classification

Learning Sparse Sharing Architectures for Multiple Tasks.

Exploring Shared Structures and Hierarchies for Multiple NLP Tasks

Recurrent Neural Network for Text Classification with Multi-Task Learning

Adversarial Multi-task Learning for Text Classification.

Deep multi-task learning with flexible and compact architecture search

Multi-task Model and Feature Joint Learning

Adaptive Sharing for Image Classification.

Meta Multi-Task Learning for Sequence Modeling.

Multi-Task Multi-Agent Shared Layers are Universal Cognition of Multi-Agent Coordination

Sharing Knowledge in Multi-Task Deep Reinforcement Learning

Traffic Flow and Speed Forecasting Through a Bayesian Deep Multi-Linear Relationship Network.

Pseudo-task Augmentation: From Deep Multitask Learning to Intratask Sharing---and Back

Deep Multi-task Learning for Facial Expression Recognition and Synthesis Based on Selective Feature Sharing

Constructing Multiple Tasks for Augmentation: Improving Neural Image Classification with K-means Features

Learning Multi-Task Communication with Message Passing for Sequence Learning.

Deep Multi-Task Augmented Feature Learning via Hierarchical Graph Neural Network

DMTMV: A Unified Learning Framework for Deep Multi-task Multi-view Learning.

Multi-Task Networks With Universe, Group, and Task Feature Learning

Distributed Multi-Task Learning with Shared Representation