Abstract:Multi-agent reinforcement learning shines as the pinnacle of multi-agent systems, conquering intricate real-world challenges, fostering collaboration and coordination among agents, and unleashing the potential for intelligent decision-making across domains. However, training a multi-agent reinforcement learning network is a formidable endeavor, demanding substantial computational resources to interact with diverse environmental variables, extract state representations, and acquire decision-making knowledge. The recent breakthroughs in large-scale pre-trained models ignite our curiosity: Can we uncover shared knowledge in multi-agent reinforcement learning and leverage pre-trained models to expedite training for future tasks? Addressing this issue, we present an innovative multi-task learning approach that aims to extract and harness common decision-making knowledge, like cooperation and competition, across different tasks. Our approach involves concurrent training of multiple multi-agent tasks, with each task employing independent front-end perception layers while sharing back-end decision-making layers. This effective decoupling of state representation extraction from decision-making allows for more efficient training and better transferability. To evaluate the efficacy of our proposed approach, we conduct comprehensive experiments in two distinct environments: the StarCraft Multi-agent Challenge (SMAC) and the Google Research Football (GRF) environments. The experimental results unequivocally demonstrate the smooth transferability of the shared decision-making network to other tasks, thereby significantly reducing training costs and improving final performance. Furthermore, visualizations authenticate the presence of general multi-agent decision-making knowledge within the shared network layers, further validating the effectiveness of our approach.

A brain-inspired theory of mind spiking neural network improves multi-agent cooperation and competition

A Brain-inspired Theory of Collective Mind Model for Efficient Social Cooperation

ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mind

Modeling Theory of Mind in Multi-Agent Games Using Adaptive Feedback Control

Unveiling the latent dynamics in social cognition with multi-agent inverse reinforcement learning

Emergence of Theory of Mind Collaboration in Multiagent Systems

Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learning

Mutual Theory of Mind in Human-AI Collaboration: An Empirical Study with LLM-driven AI Agents in a Real-time Shared Workspace Task

On computational models of theory of mind and the imitative reinforcement learning in spiking neural networks

Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions

A Brain-Inspired Model of Theory of Mind

A Bayesian theory of mind approach to modeling cooperation and communication

Theory of Mind for Multi-Agent Collaboration via Large Language Models

Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker

Mixture of personality improved Spiking actor network for efficient multi-agent cooperation

Multi-Agent Incentive Communication via Decentralized Teammate Modeling

Multi-Task Multi-Agent Shared Layers are Universal Cognition of Multi-Agent Coordination

Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs

Hypothetical Minds: Scaffolding Theory of Mind for Multi-Agent Tasks with Large Language Models

Cognitive Insights and Stable Coalition Matching for Fostering Multi-Agent Cooperation

Enhancing Robot Assistive Behaviour with Reinforcement Learning and Theory of Mind