Abstract:Networked robots have become crucial for unmanned applications since they can collaborate to complete complex tasks in remote/hazardous/depopulated areas. Due to the cost inefficiency of deploying cellular network infrastructure in these areas, hybrid satellite-UAV networks emerge as a promising solution. These networks provide seamless and on-demand connectivity for multiple robots with various task requirements, and support computation-intensive and latency-sensitive services through mobile edge computing (MEC)-based offloading. However, to complete tasks in limited times, the rapid collective movement of mobile robots may cause frequent service migration, and a large number of gathered robots may compete for limited bandwidth resources in satellite and UAV communications. As a result, offloading latency may increase significantly. To address this issue, the average completion time of multi-robot offloading in task-oriented satellite-UAV networks with MEC is formulated as an optimization problem. Unlike conventional mobility-aware MEC-based offloading schemes, joint optimization of mobility control, data offloading, and resource allocation is proposed using velocity control of multiple robots. According to Lyapunov optimization, the original optimization problem is simplified into minimizing the average completion time of offloading for all robots within UAV and satellite coverage. A multi-agent $Q$ -learning algorithm, including multi-group dual-agent $Q$ -learning, is proposed based on local state observation and global reward calculation. In each dual-agent $Q$ -learning, one agent is responsible for velocity control and communication resource allocation, while the other is responsible for data offloading and computational resource allocation. The convergence of the proposed multi-agent $Q$ -learning algorithm is also theoretically analyzed. Simulation results show that the proposed scheme can effectively reduce the offloading latency by up to 35% in the multi-robot environment over its conventional counterparts.

Efficient UAV/Satellite-assisted IoT Task Offloading: A Multi-agent Reinforcement Learning Solution

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Mobile-Aware Service Offloading for UAV-Assisted IoVs: A Multi-Agent Tiny Distributed Learning Approach

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Task-Oriented Satellite-UAV Networks with Mobile-Edge Computing

Multi-Agent DRL for Task Offloading and Resource Allocation in Multi-UAV Enabled IoT Edge Network

Latency-aware task offloading in UAV-assisted edge computing: Leveraging deep reinforcement learning

Computation Offloading Via Multi-Agent Deep Reinforcement Learning in Aerial Hierarchical Edge Computing Systems

Decentralized Computation Offloading With Cooperative UAVs: Multi-Agent Deep Reinforcement Learning Perspective

Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks

An intelligent task offloading method based on multi-agent deep reinforcement learning in ultra-dense heterogeneous network with mobile edge computing

Multi-Agent Learning-Based Optimal Task Offloading and UAV Trajectory Planning for AGIN-Power IoT

Joint Multi-task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT

Learning-Based Computation Offloading Approaches in UAVs-Assisted Edge Computing

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Distributed Offloading for Multi-UAV Swarms in MEC-Assisted 5G Heterogeneous Networks

Multi-Agent Deep Reinforcement Learning Offloading Algorithm Based on Resource Reservation and Task Adjustment

Multi-Agent Collaborative Optimization of UAV Trajectory and Latency-Aware DAG Task Offloading in UAV-Assisted MEC