Abstract:Heterogeneous multiagent systems are characterized by diverse task distributions, which are prevalent in practical scenarios, such as distributed decision making and robotic collaboration. A significant challenge in these systems is the constraint of limited observations, where each agent has access only to partial information. Many studies facilitate information exchange by employing shared parameters among agents. However, this approach is generally more effective for homogeneous systems where agents have similar observation or action spaces. In heterogeneous systems, indiscriminate parameter sharing can significantly increase the exploration cost required for effective adaptation. To address this challenge, we propose a novel communication complementary graph model (CCGM) for enhancing collaboration in heterogeneous multiagent systems. Our approach builds upon the training framework of heterogeneous agent reinforcement learning (HARL) with trust region learning and nonparameter sharing. This model utilizes advantage function decomposition and sequential updates to promote policy convergence. Within this framework, we introduce a novel communication method inspired by signaling games, where agents acting as receivers, process messages from other agents alongside their own observations. CCGM aligns the messages with observations in a graph-based communication module, which establishes communication relationships and supplements observational information. Subsequently, agents generate self-interested information, which they then share with others as senders. We evaluate our algorithm across various environments, including multiagent particle environments (MPE) and multiagent MuJoCo (MAMuJoCo) robot experiments. The results demonstrate the effectiveness of CCGM in enhancing HARL-based algorithms.

Token Based Resource Sharing In Heterogeneous Multi-Agent Teams

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

An Integrated Token-Based Algorithm for Scalable Coordination

An Information Sharing Algorithm for Large Dynamic Mobile Multi-Agent Teams

An efficient information sharing approach for large scale multi-agent team.

A POMDP Approach to Token-Based Team Coordination

A Stable And Efficient Scheme For Task Allocation Via Agent Coalition Formation

Matrix-Based Information Sharing Approach for Dynamic Robot Teams

Adaptive Task Allocation for Multi-agent Cooperation with Unknown Capabilities

Distributed Algorithm for a Finite Time Horizon Resource Allocation over a Directed Network

Enhancing Collaboration in Heterogeneous Multiagent Systems Through Communication Complementary Graph

Credit assignment in heterogeneous multi-agent reinforcement learning for fully cooperative tasks

Hedonic Coalition Formation for Distributed Task Allocation in Heterogeneous Multi-agent System

Transfer of resource allocation between overlapping and embedded communities in multiagent social networks

Multi-agent Resource Allocation Strategy for UAV Swarm-Based Cooperative Sensing

Decentralized Opportunistic Spectrum Resources Access Model and Algorithm Toward Cooperative Ad-Hoc Networks

Greedy Decentralized Auction-based Task Allocation for Multi-Agent Systems

Resource allocation in dynamic multiagent systems

Multiagent-Based Allocation of Complex Tasks in Social Networks

A Combined Multi-Agent System for Distributed Multi-Project Scheduling Problems

An Optimal Task Allocation Strategy for Heterogeneous Multi-Robot Systems