Abstract:Heterogeneous multiagent systems are characterized by diverse task distributions, which are prevalent in practical scenarios, such as distributed decision making and robotic collaboration. A significant challenge in these systems is the constraint of limited observations, where each agent has access only to partial information. Many studies facilitate information exchange by employing shared parameters among agents. However, this approach is generally more effective for homogeneous systems where agents have similar observation or action spaces. In heterogeneous systems, indiscriminate parameter sharing can significantly increase the exploration cost required for effective adaptation. To address this challenge, we propose a novel communication complementary graph model (CCGM) for enhancing collaboration in heterogeneous multiagent systems. Our approach builds upon the training framework of heterogeneous agent reinforcement learning (HARL) with trust region learning and nonparameter sharing. This model utilizes advantage function decomposition and sequential updates to promote policy convergence. Within this framework, we introduce a novel communication method inspired by signaling games, where agents acting as receivers, process messages from other agents alongside their own observations. CCGM aligns the messages with observations in a graph-based communication module, which establishes communication relationships and supplements observational information. Subsequently, agents generate self-interested information, which they then share with others as senders. We evaluate our algorithm across various environments, including multiagent particle environments (MPE) and multiagent MuJoCo (MAMuJoCo) robot experiments. The results demonstrate the effectiveness of CCGM in enhancing HARL-based algorithms.

A Multi-Agent Coordination Communication Paradigm in Adversarial Periodic Team Synchronization Environment

Multi-agent Coordination Under Temporal Logic Tasks and Team-Wise Intermittent Communication

A Plan Recognition Approach for Agent in Adversarial Multi-Agent System

Enhancing Multi-Agent Coordination through Common Operating Picture Integration

Multi-Agent Coordination for a Partially Observable and Dynamic Robot Soccer Environment with Limited Communication

A Multi-agent Formation Control Algorithm in Interference Environment

Coach-Player Multi-Agent Reinforcement Learning for Dynamic Team Composition

Multi-Agent Coordination via Multi-Level Communication

Observer-Based Asynchronous Communication and Adaptive Control Protocols with Intermittent Updating and Interaction.

Team-wise effective communication in multi-agent reinforcement learning

Towards Flexible Coordination of Large Scale Multi-Agent Teams

Multi-Agent Synchronization Tasks

Multi-Agent Reinforcement Learning for Pragmatic Communication and Control

Towards Distributed Communication and Control in Real-World Multi-Agent Reinforcement Learning

Learning to Schedule Communication in Multi-agent Reinforcement Learning

Enhancing Collaboration in Heterogeneous Multiagent Systems Through Communication Complementary Graph

Research on Decentralized Communication Decision in the Multi-Agent Robotic System

Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Games

Emergence of Theory of Mind Collaboration in Multiagent Systems

Modeling Communication of Collaborative Multi-Agent System under Epistemic Planning

Research of Communication Mechanism of the Multi—agent in Multi—agent Robot Systems