Abstract:In this paper we consider the problem of coordinating robotic systems with different kinematics, sensing and vision capabilities to achieve certain mission goals. An approach that makes use of a heterogeneous team of agents has several advantages when cost, integration of capabilities, or large search areas need to be considered. A heterogeneous team allows for the robots to become "specialized", accomplish sub-goals more effectively, and thus increase the overall mission efficiency. Two main scenarios are considered in this work. In the first case study we exploit mobility to implement a power control algorithm that increases the Signal to Interference plus Noise Ratio (SINR) among certain members of the network. We create realistic sensing fields and manipulation by using the geometric properties of the sensor field-of-view and the manipulability metric, respectively. The control strategy for each agent of the heterogeneous system is governed by an artificial physics law that considers the different kinematics of the agents and the environment, in a decentralized fashion. Through simulation results we show that the network is able to stay connected at all times and covers the environment well. The second scenario studied in this paper is the biologically-inspired coordination of heterogeneous physical robotic systems. A team of ground rovers, designed to emulate desert seed-harvester ants, explore an experimental area using behaviors fine-tuned in simulation by a genetic algorithm. Our robots coordinate with a base station and collect clusters of resources scattered within the experimental space. We demonstrate experimentally that through coordination with an aerial vehicle, our ant-like ground robots are able to collect resources two times faster than without the use of heterogeneous coordination.

Heterogeneous Policy Networks for Composite Robot Team Communication and Coordination

Heterogeneous Multi-Robot Reinforcement Learning

Generalization of Heterogeneous Multi-Robot Policies via Awareness and Communication of Capabilities

Enhancing Heterogeneous Multi-Agent Cooperation in Decentralized MARL via GNN-driven Intrinsic Rewards

Cooperative Policy Learning with Pre-trained Heterogeneous Observation Representations

Enhancing Collaboration in Heterogeneous Multiagent Systems Through Communication Complementary Graph

Multiagent Reinforcement Learning With Heterogeneous Graph Attention Network

Learning Coordination Policies over Heterogeneous Graphs for Human-Robot Teams via Recurrent Neural Schedule Propagation

Exploiting Heterogeneous Robotic Systems in Cooperative Missions

Heterogeneous Multi-Robot Cooperation With Asynchronous Multi-Agent Reinforcement Learning

Leveraging Large Language Model for Heterogeneous Ad Hoc Teamwork Collaboration

Hierarchical Consensus-Based Multi-Agent Reinforcement Learning for Multi-Robot Cooperation Tasks

Heterogeneous-Agent Reinforcement Learning

Hierarchical Coordination Multi-Agent Reinforcement Learning with Spatio-Temporal Abstraction

Stateful active facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learning

Multi-Agent Actor Critic for Channel Allocation in Heterogeneous Networks.

Heterogeneous Multi-Agent Reinforcement Learning for Zero-Shot Scalable Collaboration

COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language Models

Heterogeneous Multi-Agent Communication Learning Via Graph Information Maximization.

Multi-Agent Feature Learning and Integration for Mixed Cooperative and Competitive Environment.