Abstract:Traditional low earth orbit (LEO) satellite networks are typically independent of terrestrial networks, which develop relatively slowly due to the on-board capacity limitation. By integrating emerging mobile edge computing (MEC) with LEO satellite networks to form the business-oriented "end-edge-cloud" multi-level computing architecture, some computing-sensitive tasks can be offloaded by ground terminals to satellites, thereby satisfying more tasks in the network. How to make computation offloading and resource allocation decisions in LEO satellite edge networks, nevertheless, indeed poses challenges in tracking network dynamics and handling sophisticated actions. For the discrete-continuous hybrid action space and time-varying networks, this work aims to use the parameterized deep Q-network (P-DQN) for the joint computation offloading and resource allocation. First, the characteristics of time-varying channels are modeled, and then both communication and computation models under three different offloading decisions are constructed. Second, the constraints on task offloading decisions, on remaining available computing resources, and on the power control of LEO satellites as well as the cloud server are formulated, followed by the maximization problem of satisfied task number over the long run. Third, using the parameterized action Markov decision process (PAMDP) and P-DQN, the joint computing offloading, resource allocation, and power control are made in real time, to accommodate dynamics in LEO satellite edge networks and dispose of the discrete-continuous hybrid action space. Simulation results show that the proposed P-DQN method could approach the optimal control, and outperforms other reinforcement learning (RL) methods for merely either discrete or continuous action space, in terms of the long-term rate of satisfied tasks.

Latency-Energy Efficient Task Offloading in the Satellite Network-Assisted Edge Computing Via Deep Reinforcement Learning

Adaptive Task Offloading with Spatiotemporal Load Awareness in Satellite Edge Computing

Task Offloading With Service Migration for Satellite Edge Computing: A Deep Reinforcement Learning Approach

Dual Network Computation Offloading Based on DRL for Satellite-Terrestrial Integrated Networks

Cooperative Multi-Agent Deep Reinforcement Learning for Computation Offloading in Digital Twin Satellite Edge Networks

Security-Sensitive Task Offloading in Integrated Satellite-Terrestrial Networks

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

A Policy Based Deep Reinforcement Learning for Task Offloading and Resource Allocation in Satellite Terrestrial Integrated Internet of Things

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Joint Computation Offloading and Resource Allocation for Hybrid Cloud and Edge Computing in Satellite-assisted Unmanned System

Edge Computing Task Offloading Based on Game Theory for Space-Air-Ground Integrated Network

Edge computing collaborative offloading strategy for space‐air‐ground integrated networks

Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning

Edge computing offloading strategy for space-air-ground integrated network based on game theory

Hierarchical Dynamic Resource Allocation for Computation Offloading in LEO Satellite Networks

Joint Multi-task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT

Deep Reinforcement Learning for Privacy-Preserving Task Offloading in Integrated Satellite-Terrestrial Networks

Online Computation Offloading for Collaborative Space/Aerial-Aided Edge Computing Toward 6G System

Computation Offloading and Resource Allocation Based on P-DQN in LEO Satellite Edge Networks

Multiagent Reinforcement Learning for Task Offloading of Space/Aerial-Assisted Edge Computing