Abstract:Internet of Robotic Things (IoRT) emphasizes the integrated robotic, artificial intelligence computing, and communication technologies, enabling more sophisticated operations and decision-making. As a crucial element of IoRT, mission-critical applications, such as industrial manufacturing and emergency services, impose stringent requirements on ultra-reliable and low-latency communication (URLLC). The paper focuses on addressing URLLC challenges in the context of IoRT, particularly when autonomous mobile robots (AMRs) coexist with static sensors. We prioritize safe and efficient AMRs’ travel through trajectory design and communication resource allocation in IoRT systems without the need of any prior knowledge. To enhance network connectivity and exploit diversity gains, we introduce the flexible decoding and free clustering as the next-generation multiple access technologies in spectrum-limited downlink IoRT system. Then, aiming at minimizing the decoding error probability and travel time, we formulate a long-term multi-objective optimization problem by jointly designing AMRs’ trajectory and communication resource. To accommodate the inherent dynamics and unpredictability in the IoRT system, we introduce a multi-agent actor-critic deep reinforcement learning (DRL) framework, offering four distinct implementations, each accompanied by comprehensive complexity analyses. Simulation results reveal the following insights: 1) in terms of DRL implementations, off-policy algorithms with deterministic policies outperform their on-policy counterparts, achieving approximately a 67% increase in rewards; 2) In terms of communication schemes, our proposed flexible decoding and free clustering strategies under designed trajectories can effectively reduce decoding errors; 3) In terms of algorithm optimality, our DRL framework shows superior flexibility and adaptability in communication environments compared to traditional A* search and heuristic methods.

Visualizing Multi-Agent Reinforcement Learning for Robotic Communication in Industrial IoT Networks

TraCo: Learning Virtual Traffic Coordinator for Cooperation with Multi-Agent Reinforcement Learning.

Joint Trajectory and Radio Resource Optimization for Autonomous Mobile Robots Exploiting Multi-Agent Reinforcement Learning

Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things

Efficient Communications in Multi-Agent Reinforcement Learning for Mobile Applications

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

Intelligent Communication Planning for Constrained Environmental IoT Sensing with Reinforcement Learning

Multi-Robot Cooperative Socially-Aware Navigation Using Multi-Agent Reinforcement Learning

Reinforcement Learning based Multi-connectivity Resource Allocation in Factory Automation Systems

Multi-Agent Reinforcement Learning for Pragmatic Communication and Control

From Multi-agent to Multi-robot: A Scalable Training and Evaluation Platform for Multi-robot Reinforcement Learning

Communication-Aware Path Design for Indoor Robots Exploiting Federated Deep Reinforcement Learning

An Edge Based Multi-Agent Auto Communication Method for Traffic Light Control

Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey

Multi-agent reinforcement learning for intelligent resource allocation in IIoT networks

Robust Multi-Agent Reinforcement Learning with Social Empowerment for Coordination and Communication

Autonomous Swarm Robot Coordination via Mean-Field Control Embedding Multi-Agent Reinforcement Learning

Multiple Ships Cooperative Navigation and Collision Avoidance using Multi-agent Reinforcement Learning with Communication

Distributed localization for IoT with multi-agent reinforcement learning

Poster Abstract: Emergency Networking Using UAVs: A Reinforcement Learning Approach with Large Language Model

Collaborative multi-agents in dynamic industrial internet of things using deep reinforcement learning