Abstract:Traditional low earth orbit (LEO) satellite networks are typically independent of terrestrial networks, which develop relatively slowly due to the on-board capacity limitation. By integrating emerging mobile edge computing (MEC) with LEO satellite networks to form the business-oriented "end-edge-cloud" multi-level computing architecture, some computing-sensitive tasks can be offloaded by ground terminals to satellites, thereby satisfying more tasks in the network. How to make computation offloading and resource allocation decisions in LEO satellite edge networks, nevertheless, indeed poses challenges in tracking network dynamics and handling sophisticated actions. For the discrete-continuous hybrid action space and time-varying networks, this work aims to use the parameterized deep Q-network (P-DQN) for the joint computation offloading and resource allocation. First, the characteristics of time-varying channels are modeled, and then both communication and computation models under three different offloading decisions are constructed. Second, the constraints on task offloading decisions, on remaining available computing resources, and on the power control of LEO satellites as well as the cloud server are formulated, followed by the maximization problem of satisfied task number over the long run. Third, using the parameterized action Markov decision process (PAMDP) and P-DQN, the joint computing offloading, resource allocation, and power control are made in real time, to accommodate dynamics in LEO satellite edge networks and dispose of the discrete-continuous hybrid action space. Simulation results show that the proposed P-DQN method could approach the optimal control, and outperforms other reinforcement learning (RL) methods for merely either discrete or continuous action space, in terms of the long-term rate of satisfied tasks.

Federated Deep Recurrent Q-Learning for Task Partitioning and Resource Allocation in Satellite Mobile-Edge-Computing-Assisted Industrial IoT

Task Offloading With Service Migration for Satellite Edge Computing: A Deep Reinforcement Learning Approach

Reinforcement Learning-based Mobile Edge Computing and Transmission Scheduling for Video Surveillance

Task Offloading and Resource Allocation Strategy Based on Deep Learning for Mobile Edge Computing

Joint Multi-task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT

Online learning-based offloading decision and resource allocation in mobile edge computing-enabled satellite-terrestrial networks

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

Federated deep reinforcement learning-based online task offloading and resource allocation in harsh mobile edge computing environment

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

DQN-based mobile edge computing for smart Internet of vehicle

Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Industrial IoT in MEC Federation System

Task Offloading based on Deep Reinforcement Learning with LSTM for Mobile Edge Computing

Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Energy-Efficient Task Split and Resource Allocation in LEO-Satellite-Assisted IoT Network

Task offloading mechanism based on federated reinforcement learning in mobile edge computing

Computation Offloading and Resource Allocation Based on P-DQN in LEO Satellite Edge Networks

Federated Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Smart Cities in a Mobile Edge Network

Deep Learning Based Joint Resource Scheduling Algorithms for Hybrid MEC Networks

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment