Abstract:Abstract In recent years, the development of Low Earth Orbit (LEO) satellites and the advancement of the Mobile Edge Computing (MEC) paradigm have addressed the requirement for Satellite Mobile Edge Computing (Sat-MEC) servers to support remote Internet of Things (IoT) Mobile devices (IMDs) in the absence of terrestrial networks. However, optimizing the execution time of ground-based tasks in this scenario is still a huge challenge due to the heterogeneity of tasks and Sat-MEC servers.In this paper, we proposed an algorithm in the context of Sat-MEC architecture aimed at minimizing average tasks processing time. In a significant portion of other papers that have considered the access of Sat-MEC to terrestrial network architectures, the interplay between task characteristics and server characteristics is often not considered simultaneously, and basically only single tasks are considered in sequence for offloading decisions, which is difficult to seek the optimal average processing time for multiple tasks, therefore, we proposed a algorithm which considers several factors, including the collaboration among LEO satellites, the concurrency and heterogeneity of tasks, the dynamics of LEO satellites, the heterogeneity of computation capability of Sat-MEC servers, and the heterogeneity of the initial queue for task computation. Due to the stochastic nature of the optimization problem and the high-dimensional nature of the solution space, we apply a deep reinforcement learning method to navigate through this high-dimensional space. And use a self-attentive mechanism in the Q-network to extract relational features between tasks and Sat-MEC servers. The decision process of task offloading solutions is determined by the similarity values between tasks and Sat-MEC servers. Simulation results confirm the effectiveness of our proposed algorithm, showing that the average processing time of tasks is lower compared to other baseline solutions.

Optimizing On-Satellite Data Analysis with Reinforcement Learning

Deep Reinforcement Learning-Based Periodic Earth Observation Scheduling for Agile Satellite Constellation.

Deep Reinforcement Learning-Based Autonomous Mission Planning Method for High and Low Orbit Multiple Agile Earth Observing Satellites

Deep Reinforcement Learning for Privacy-Preserving Task Offloading in Integrated Satellite-Terrestrial Networks

Minimize Average Tasks Processing Time in Satellite MobileEdge Computing Systems via a Deep Reinforcement Learning Method

A Hierarchical Resource Scheduling Method for Satellite Control System Based on Deep Reinforcement Learning

Revising the Observation Satellite Scheduling Problem Based on Deep Reinforcement Learning

Data-Driven Collaborative Scheduling Method for Multi-Satellite Data-Transmission

Minimize average tasks processing time in satellite mobile edge computing systems via a deep reinforcement learning method

Machine Learning-Based Resource Allocation in Satellite Networks Supporting Internet of Remote Things

Traffic Optimization in Satellites Communications: A Multi-agent Reinforcement Learning Approach

Event-Triggered Deep Reinforcement Learning for Dynamic Task Scheduling in Multi-Satellite Resource Allocation

A Generic Markov Decision Process Model and Reinforcement Learning Method for Scheduling Agile Earth Observation Satellites

Deep Reinforcement Learning with Local Attention for Single Agile Optical Satellite Scheduling Problem

Mission Planning for Distributed Multiple Agile Earth Observing Satellites by Attention-Based Deep Reinforcement Learning Method

A Fast Approach to Satellite Range Rescheduling Using Deep Reinforcement Learning

A DRL-Based Satellite Service Allocation Method in LEO Satellite Networks

Task Offloading With Service Migration for Satellite Edge Computing: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based Joint Satellite Scheduling and Resource Allocation in Satellite-Terrestrial Integrated Networks

Resource-constrained Self-Organized Optimization for Near-Real-time Offloading Satellite Earth Observation Big Data