Abstract:The Space-Air-Ground Integrated Network (SAGIN), crucial to the advancement of sixth-generation (6G) technology, plays a key role in ensuring universal connectivity, particularly by addressing the communication needs of remote areas lacking cellular network infrastructure. This paper delves into the role of unmanned aerial vehicles (UAVs) within SAGIN, where they act as a control layer owing to their adaptable deployment capabilities and their intermediary role. Equipped with millimeter-wave (mmWave) radar and vision sensors, these UAVs are capable of acquiring multi-source data, which helps to diminish uncertainty and enhance the accuracy of decision-making. Concurrently, UAVs collect tasks requiring computing resources from their coverage areas, originating from a variety of mobile devices moving at different speeds. These tasks are then allocated to ground base stations (BSs), low-earth-orbit (LEO) satellite, and local processing units to improve processing efficiency. Amidst this framework, our study concentrates on devising dynamic strategies for facilitating task hosting between mobile devices and UAVs, offloading computations, managing associations between UAVs and BSs, and allocating computing resources. The objective is to minimize the time-averaged network cost, considering the uncertainty of device locations, speeds, and even types. To tackle these complexities, we propose a deep reinforcement learning and perception-aided online approach (DRL-and-Perception-aided Approach) for this joint optimization in SAGIN, tailored for an environment filled with uncertainties. The effectiveness of our proposed approach is validated through extensive numerical simulations, which quantify its performance relative to various network parameters.

Deep Deterministic Policy Gradient Algorithm for Space/Aerial-Assisted Computation Offloading

Multiagent Reinforcement Learning for Task Offloading of Space/Aerial-Assisted Edge Computing

Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach

Curriculum Reinforcement Learning-Based Computation Offloading Approach in Space-Air-Ground Integrated Network

Cost-Efficient Computation Offloading in SAGIN: A Deep Reinforcement Learning and Perception-Aided Approach

Satellite Edge Computing with Collaborative Computation Offloading: an Intelligent Deep Deterministic Policy Gradient Approach

Joint Offloading and Resource Allocation for Hybrid Cloud and Edge Computing in SAGINs: A Decision Assisted Hybrid Action Space Deep Reinforcement Learning Approach

Collaborative Computation Offloading and Resource Management in Space–Air–Ground Integrated Networking: A Deep Reinforcement Learning Approach

Joint Delay and Completion Rate Optimization for Dependent Task Offloading in Space-Air-Ground Integrated Network

Computation offloading optimization for UAV-assisted mobile edge computing: a deep deterministic policy gradient approach

Deep Reinforcement Learning for Computation Offloading in Mobile Edge Computing Environment.

Joint Latency-Oriented, Energy Consumption, and Carbon Emission for a Space–Air–Ground Integrated Network with Newly Designed Power Technology

Deep Deterministic Policy Gradient-Based Algorithm for Computation Offloading in IoV

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Online Joint Data Offloading and Power Control for Space-Air-Ground Integrated Networks

Cluster-Based Multi-Agent Task Scheduling for Space-Air-Ground Integrated Networks

Computing Assistance from the Sky: Decentralized Computation Efficiency Optimization for Air-Ground Integrated MEC Networks

Edge computing offloading strategy for space-air-ground integrated network based on game theory

Online Computation Offloading for Collaborative Space/Aerial-Aided Edge Computing Toward 6G System

Edge Computing Task Offloading Based on Game Theory for Space-Air-Ground Integrated Network