Abstract:Networked robots have become crucial for unmanned applications since they can collaborate to complete complex tasks in remote/hazardous/depopulated areas. Due to the cost inefficiency of deploying cellular network infrastructure in these areas, hybrid satellite-UAV networks emerge as a promising solution. These networks provide seamless and on-demand connectivity for multiple robots with various task requirements, and support computation-intensive and latency-sensitive services through mobile edge computing (MEC)-based offloading. However, to complete tasks in limited times, the rapid collective movement of mobile robots may cause frequent service migration, and a large number of gathered robots may compete for limited bandwidth resources in satellite and UAV communications. As a result, offloading latency may increase significantly. To address this issue, the average completion time of multi-robot offloading in task-oriented satellite-UAV networks with MEC is formulated as an optimization problem. Unlike conventional mobility-aware MEC-based offloading schemes, joint optimization of mobility control, data offloading, and resource allocation is proposed using velocity control of multiple robots. According to Lyapunov optimization, the original optimization problem is simplified into minimizing the average completion time of offloading for all robots within UAV and satellite coverage. A multi-agent $Q$ -learning algorithm, including multi-group dual-agent $Q$ -learning, is proposed based on local state observation and global reward calculation. In each dual-agent $Q$ -learning, one agent is responsible for velocity control and communication resource allocation, while the other is responsible for data offloading and computational resource allocation. The convergence of the proposed multi-agent $Q$ -learning algorithm is also theoretically analyzed. Simulation results show that the proposed scheme can effectively reduce the offloading latency by up to 35% in the multi-robot environment over its conventional counterparts.

Unleashing Collaborative Computing for Adaptive Video Streaming with Multi-objective Optimization in Satellite Terrestrial Networks

Collaborative Satellite Computing through Adaptive DNN Task Splitting and Offloading

Collaborative Task Offloading Optimization for Satellite Mobile Edge Computing Using Multi-Agent Deep Reinforcement Learning

Inter-Satellite Cooperative Offloading Decision and Resource Allocation in Mobile Edge Computing-Enabled Satellite–Terrestrial Networks

Collaborative Computation Offloading and Resource Allocation in Satellite Edge Computing

Joint Delay and Completion Rate Optimization for Dependent Task Offloading in Space-Air-Ground Integrated Network

Optimal Computation Offloading in Collaborative LEO-IoT Enabled MEC: A Multiagent Deep Reinforcement Learning Approach

Joint Multi-task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT

Cooperative Multi-Agent Deep Reinforcement Learning for Computation Offloading in Digital Twin Satellite Edge Networks

Exploiting Collaborative Computing to Improve Downlink Sum Rate in Satellite Integrated Terrestrial Networks

Latency-Energy Efficient Task Offloading in the Satellite Network-Assisted Edge Computing Via Deep Reinforcement Learning

Online learning-based offloading decision and resource allocation in mobile edge computing-enabled satellite-terrestrial networks

Task-Oriented Satellite-UAV Networks with Mobile-Edge Computing

An Energy-Efficient Collaborative Offloading Scheme with Heterogeneous Tasks for Satellite Edge Computing

CCOS: A Coded Computation Offloading Strategy for Satellite-Terrestrial Integrated Networks

Joint Offloading Selection, Beamforming Design and Resource Allocation for Satellite-Terrestrial Computing.

Dynamic User Association and Computation Offloading in Satellite Edge Computing Networks Via Deep Reinforcement Learning

Joint Optimization of Server and Service Selection in Satellite-Terrestrial Integrated Edge Computing Networks

Delay-optimal Multi-Satellite Collaborative Computation Offloading Supported by OISL in LEO Satellite Network

Deep Reinforcement Learning-Based Joint Satellite Scheduling and Resource Allocation in Satellite-Terrestrial Integrated Networks