Abstract:In Space–Air–Ground Integrated Networks (SAGIN), computation offloading technology is a new way to improve the processing efficiency of node tasks and improve the limitation of computing storage resources. To solve the problem of large delay and energy consumption cost of task computation offloading, which caused by the complex and variable network offloading environment and a large amount of offloading tasks, a computation offloading decision scheme based on Markov and Deep Q Networks (DQN) is proposed. First, we select the optimal offloading network based on the characteristics of the movement of the task offloading process in the network. Then, the task offloading process is transformed into a Markov state transition process to build a model of the computational offloading decision process. Finally, the delay and energy consumption weights are introduced into the DQN algorithm to update the computation offloading decision process, and the optimal offloading decision under the low cost is achieved according to the task attributes. The simulation results show that compared with the traditional Lyapunov-based offloading decision scheme and the classical Q-learning algorithm, the delay and energy consumption are respectively reduced by 68.33% and 11.21%, under equal weights when the offloading task volume exceeds 500 Mbit. Moreover, compared with offloading to edge nodes or backbone nodes of the network alone, the proposed mixed offloading model can satisfy more than 100 task requests with low energy consumption and low delay. It can be seen that the computation offloading decision proposed in this paper can effectively reduce the delay and energy consumption during the task computation offloading in the Space–Air–Ground Integrated Network environment, and can select the optimal offloading sites to execute the tasks according to the characteristics of the task itself.

Collaborative Computation Offloading and Resource Management in Space–Air–Ground Integrated Networking: A Deep Reinforcement Learning Approach

Cost-Efficient Computation Offloading in SAGIN: A Deep Reinforcement Learning and Perception-Aided Approach

Joint Offloading and Resource Allocation for Hybrid Cloud and Edge Computing in SAGINs: A Decision Assisted Hybrid Action Space Deep Reinforcement Learning Approach

Distributed Deep Reinforcement Learning Assisted Resource Allocation Algorithm for Space-Air-Ground Integrated Networks

Multiagent Reinforcement Learning for Task Offloading of Space/Aerial-Assisted Edge Computing

Curriculum Reinforcement Learning-Based Computation Offloading Approach in Space-Air-Ground Integrated Network

Incorporating Distributed DRL into Storage Resource Optimization of Space-Air-Ground Integrated Wireless Communication Network

Fair Resource Allocation For Hierarchical Federated Edge Learning in Space-Air-Ground Integrated Networks via Deep Reinforcement Learning with Hybrid Control

Deep Reinforcement Learning Based Cooperative Task Offloading and Resource Allocation in Mmwave-Enabled Space-Air-Ground Integrated Networks

A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing

Deep Reinforcement Learning-Based Computation Offloading and Resource Allocation in IoT

Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT

Deep Reinforcement Learning for Edge Computing and Resource Allocation in 5G Beyond

Deep Reinforcement Learning-Based Multi-node Collaborative Task Offloading Optimization in 6G Space-Air-Ground Integrated Networks

Deep Deterministic Policy Gradient Algorithm for Space/Aerial-Assisted Computation Offloading

Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

Optimization of Air Network Resources Based on Deep Reinforcement Learning

Research on Task-Oriented Computation Offloading Decision in Space-Air-Ground Integrated Network.

Demand-Driven Task Scheduling and Resource Allocation in Space-Air-Ground Integrated Network: A Deep Reinforcement Learning Approach