Abstract:In this paper we consider the problem of coordinating robotic systems with different kinematics, sensing and vision capabilities to achieve certain mission goals. An approach that makes use of a heterogeneous team of agents has several advantages when cost, integration of capabilities, or large search areas need to be considered. A heterogeneous team allows for the robots to become "specialized", accomplish sub-goals more effectively, and thus increase the overall mission efficiency. Two main scenarios are considered in this work. In the first case study we exploit mobility to implement a power control algorithm that increases the Signal to Interference plus Noise Ratio (SINR) among certain members of the network. We create realistic sensing fields and manipulation by using the geometric properties of the sensor field-of-view and the manipulability metric, respectively. The control strategy for each agent of the heterogeneous system is governed by an artificial physics law that considers the different kinematics of the agents and the environment, in a decentralized fashion. Through simulation results we show that the network is able to stay connected at all times and covers the environment well. The second scenario studied in this paper is the biologically-inspired coordination of heterogeneous physical robotic systems. A team of ground rovers, designed to emulate desert seed-harvester ants, explore an experimental area using behaviors fine-tuned in simulation by a genetic algorithm. Our robots coordinate with a base station and collect clusters of resources scattered within the experimental space. We demonstrate experimentally that through coordination with an aerial vehicle, our ant-like ground robots are able to collect resources two times faster than without the use of heterogeneous coordination.

Embodied, Intelligent Communication for Multi-Agent Cooperation

A Hierarchical Coordination Framework for Joint Perception-Action Tasks in Composite Robot Teams

HARMONIC: Cognitive and Control Collaboration in Human-Robotic Teams

Modeling Communication of Collaborative Multi-Agent System under Epistemic Planning

Multi-Agent Reinforcement Learning for Pragmatic Communication and Control

Cooperative Heterogeneous Multi-Robot Systems

Conversational Language Models for Human-in-the-Loop Multi-Robot Coordination

Emergent Communication in Multi-Agent Reinforcement Learning for Future Wireless Networks

Robust Multi-Agent Reinforcement Learning with Social Empowerment for Coordination and Communication

Generalising Multi-Agent Cooperation through Task-Agnostic Communication

Two Heads Are Better Than One: Collaborative LLM Embodied Agents for Human-Robot Interaction

On Emergent Communication in Competitive Multi-Agent Teams

Collaborative Behavior Models for Optimized Human-Robot Teamwork

Enhancing Multi-Agent Coordination through Common Operating Picture Integration

Physical Robot Agents: Coordinated Intelligent and Rational Agents for Collaborative Robots

Collaborative Interaction Models for Optimized Human-Robot Teamwork.

Exploiting Heterogeneous Robotic Systems in Cooperative Missions

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Human-AI Teamwork Interface Design Using Patterns of Interactions

The Evolution of Cooperative Behaviours in Physically Heterogeneous Multi-Robot Systems

Generalization of Heterogeneous Multi-Robot Policies via Awareness and Communication of Capabilities