Abstract:Heterogeneous multiagent systems are characterized by diverse task distributions, which are prevalent in practical scenarios, such as distributed decision making and robotic collaboration. A significant challenge in these systems is the constraint of limited observations, where each agent has access only to partial information. Many studies facilitate information exchange by employing shared parameters among agents. However, this approach is generally more effective for homogeneous systems where agents have similar observation or action spaces. In heterogeneous systems, indiscriminate parameter sharing can significantly increase the exploration cost required for effective adaptation. To address this challenge, we propose a novel communication complementary graph model (CCGM) for enhancing collaboration in heterogeneous multiagent systems. Our approach builds upon the training framework of heterogeneous agent reinforcement learning (HARL) with trust region learning and nonparameter sharing. This model utilizes advantage function decomposition and sequential updates to promote policy convergence. Within this framework, we introduce a novel communication method inspired by signaling games, where agents acting as receivers, process messages from other agents alongside their own observations. CCGM aligns the messages with observations in a graph-based communication module, which establishes communication relationships and supplements observational information. Subsequently, agents generate self-interested information, which they then share with others as senders. We evaluate our algorithm across various environments, including multiagent particle environments (MPE) and multiagent MuJoCo (MAMuJoCo) robot experiments. The results demonstrate the effectiveness of CCGM in enhancing HARL-based algorithms.

Multi-agent Perception Via Co-attentive Communication Mechanism.

How2comm: Communication-Efficient and Collaboration-Pragmatic Multi-Agent Perception

What2comm: Towards Communication-efficient Collaborative Perception Via Feature Decoupling

Pragmatic Communication in Multi-Agent Collaborative Perception

Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perception

Multi-agent Collaborative Perception Via Motion-aware Robust Communication Network

UMC: A Unified Bandwidth-efficient and Multi-resolution based Collaborative Perception Framework

Enhancing Multi-Agent Coordination through Common Operating Picture Integration

CORE: Cooperative Reconstruction for Multi-Agent Perception

R-ACP: Real-Time Adaptive Collaborative Perception Leveraging Robust Task-Oriented Communications

Learning Attentional Communication for Multi-Agent Cooperation

Communication-Efficient Collaborative Perception via Information Filling with Codebook

MACP: Efficient Model Adaptation for Cooperative Perception

Toward Cooperative Multi-Agent Video Streaming Perception

Latency-Aware Collaborative Perception

Complementary Attention for Multi-Agent Reinforcement Learning.

Enhancing Collaboration in Heterogeneous Multiagent Systems Through Communication Complementary Graph

AgentAlign: Misalignment-Adapted Multi-Agent Perception for Resilient Inter-Agent Sensor Correlations

Hierarchical Perception-Improving for Decentralized Multi-Robot Motion Planning in Complex Scenarios