Abstract:Traditional low earth orbit (LEO) satellite networks are typically independent of terrestrial networks, which develop relatively slowly due to the on-board capacity limitation. By integrating emerging mobile edge computing (MEC) with LEO satellite networks to form the business-oriented "end-edge-cloud" multi-level computing architecture, some computing-sensitive tasks can be offloaded by ground terminals to satellites, thereby satisfying more tasks in the network. How to make computation offloading and resource allocation decisions in LEO satellite edge networks, nevertheless, indeed poses challenges in tracking network dynamics and handling sophisticated actions. For the discrete-continuous hybrid action space and time-varying networks, this work aims to use the parameterized deep Q-network (P-DQN) for the joint computation offloading and resource allocation. First, the characteristics of time-varying channels are modeled, and then both communication and computation models under three different offloading decisions are constructed. Second, the constraints on task offloading decisions, on remaining available computing resources, and on the power control of LEO satellites as well as the cloud server are formulated, followed by the maximization problem of satisfied task number over the long run. Third, using the parameterized action Markov decision process (PAMDP) and P-DQN, the joint computing offloading, resource allocation, and power control are made in real time, to accommodate dynamics in LEO satellite edge networks and dispose of the discrete-continuous hybrid action space. Simulation results show that the proposed P-DQN method could approach the optimal control, and outperforms other reinforcement learning (RL) methods for merely either discrete or continuous action space, in terms of the long-term rate of satisfied tasks.

Game-Based Computation Offloading and Power Allocation for LEO Constellation Networks in Distributed and Dynamic Environment

Multi-User Computation Offloading in Dynamic Environment for LEO Constellation Networks

Dynamic Computing Offloading Strategy in LEO Constellation Edge Computing Network

Computation Offloading in LEO Satellite Networks With Hybrid Cloud and Edge Computing

Distributed Data Offloading in Ultra-Dense LEO Satellite Networks: A Stackelberg Mean-Field Game Approach

Computation Offloading Strategies for LEO Satellite Edge Computing Systems Based on Different Multiple Access Methods

Dynamic Data Offloading for Massive Users in Ultra-dense LEO Satellite Networks Based on Stackelberg Mean Field Game

Edge-Assisted Multi-Layer Offloading Optimization of LEO Satellite-Terrestrial Integrated Networks

Cost-Efficient Computation Offloading and Service Chain Caching in LEO Satellite Networks

QoS-Aware Computation Offloading in LEO Satellite Edge Computing for IoT: A Game-Theoretical Approach

Partial Computation Offloading in Satellite based Three-Tier Cloud-Edge Integration Networks

Network-Wide Task Offloading With LEO Satellites: A Computation and Transmission Fusion Approach

Edge Computing Task Offloading Based on Game Theory for Space-Air-Ground Integrated Network

Energy-Efficient Data Offloading for Earth Observation Satellite Networks

Edge computing offloading strategy for space-air-ground integrated network based on game theory

Computation Offloading and Resource Allocation Based on P-DQN in LEO Satellite Edge Networks

Hierarchical Dynamic Resource Allocation for Computation Offloading in LEO Satellite Networks

Mobility-Aware Computation Offloading in Satellite Edge Computing Networks

Dynamic Transmission and Computation Resource Optimization for Dense LEO Satellite Assisted Mobile-Edge Computing

A cloud-edge collaborative computing framework using potential games for space-air-ground integrated IoT

Joint Communication, Computing, and Caching Resource Allocation in LEO Satellite MEC Networks