Abstract:Recently, Satellite Internet of Things (SIoT), a space network that consists of numerous Low Earth Orbit (LEO) satellites, is regarded as a promising technique since it is the only solution to provide 100% global coverage for the whole earth, without any additional terrestrial infrastructure supports. However, compared with Geostationary Earth Orbit (GEO) satellites, the LEO satellites always move very fast to cover an area within only 5–12 minutes per pass, bringing high dynamics to the network access. Furthermore, to reduce the cost, the power and spectrum channel resources of each LEO satellite are very limited, i.e., less than 10% of GEO. Therefore, to take fully advantage of the limited resource, it is very challenging to have an efficient resource allocation scheme for SIoT. Current resource allocation schemes for satellites are mostly designed for GEO, and these schemes do not consider many LEO specific concerns, including the constrained energy, the mobility characteristic, the dynamics of connections and transmissions etc. Towards this end, we proposed DeepCA, a novel reinforcement learning based approach for energy-efficient channel allocation in SIoT. In DeepCA, we firstly introduce a new sliding block scheme to facilitate the modeling of dynamic feature of the LEO satellite, and formulate the dynamic channel allocation problem in SIoT as a Markov decision process (MDP). We then propose a deep reinforcement learning algorithm for optimal channel allocation. To accelerate the learning process of DeepCA, we utilize the image form to represent the requests of users to reduce the input size, and carefully divide an action into multiple mini-actions to reduce the size of the action set. Extensive simulations show that our proposed DeepCA approach can save at least 67.86% energy consumption compared with traditional algorithms.

A Policy Based Deep Reinforcement Learning for Task Offloading and Resource Allocation in Satellite Terrestrial Integrated Internet of Things

Task Offloading With Service Migration for Satellite Edge Computing: A Deep Reinforcement Learning Approach

Online learning-based offloading decision and resource allocation in mobile edge computing-enabled satellite-terrestrial networks

Cooperative user association and resource allocation for task offloading in hybrid GEO‐LEO satellite networks

Collaborative Computing and Resource Allocation for LEO Satellite-Assisted Internet of Things

Energy-Efficient Task Split and Resource Allocation in LEO-Satellite-Assisted IoT Network

Computation Offloading and Resource Allocation Based on P-DQN in LEO Satellite Edge Networks

Joint Multi-task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT

Task Offloading in MEC-Aided Satellite-Terrestrial Networks: A Reinforcement Learning Approach.

Cooperative Multi-Agent Deep Reinforcement Learning for Computation Offloading in Digital Twin Satellite Edge Networks

Resource Allocation and Offloading Strategy for UAV-Assisted LEO Satellite Edge Computing

Deep Reinforcement Learning-Based Joint Satellite Scheduling and Resource Allocation in Satellite-Terrestrial Integrated Networks

Dual Network Computation Offloading Based on DRL for Satellite-Terrestrial Integrated Networks

Deep Reinforcement Learning-Based Resource Allocation for Satellite Internet of Things with Diverse QoS Guarantee

Deep Reinforcement Learning for Privacy-Preserving Task Offloading in Integrated Satellite-Terrestrial Networks

A Deep Reinforcement Learning Based Approach for Energy-Efficient Channel Allocation in Satellite Internet of Things

Inter-Satellite Cooperative Offloading Decision and Resource Allocation in Mobile Edge Computing-Enabled Satellite–Terrestrial Networks

Hierarchical Dynamic Resource Allocation for Computation Offloading in LEO Satellite Networks