Abstract:Satellite networks have been regarded as a promising architecture for supporting the Internet of remote things (IoRT) due to their advantages of wide coverage and high communication capacity in remote areas, which further promotes the development of the satellites for IoRT networks (SIoRTNs). The effectiveness of multi-dimensional resource collaboration has significant impacts on the IoRT data downloading performance. However, the environment ' s dynamics, e.g., channel conditions and solar infeed process, are unknown in practical scenarios, which poses daunting challenges in making efficient utilization of multi-dimensional resources. Motivated by this fact, we model the joint resource scheduling and IoRT data scheduling problem with the aim of maximizing the amount of the IoRT data of the overall network by applying the model-free reinforcement learning framework. To overcome the limitations of traditional reinforcement learning algorithms, we propose several feature functions by investigating the natural attributes of the multi-dimensional resources of the SIoRTNs, and further exploit the concept of function approximation to approximate the expected downloaded IoRT data given the network state. Furthermore, we propose a state-action-reward-state-action (SARSA) based actor-critic reinforcement learning (SACRL) resource allocation strategy to achieve the optimal resource allocation and IoRT data scheduling with casual information at LEO satellites. Simulations validate the convergence property and the effectiveness of the proposed SACRL algorithm in terms of the amount of the downloaded IoRT data. Particularly, we investigate the impact of typical network parameters on network performance to further provide guidance for future SIoRTN system design.

Age-Aware Task Scheduling Scheme in Hybrid GEO-LEO Satellite Networks

Intelligent Task Scheduling in Hybrid GEO-LEO Satellite-Assisted Marine IoT Network

Age-oriented Access Control in GEO/LEO Heterogeneous Network for Marine IoRT.

Cooperative user association and resource allocation for task offloading in hybrid GEO‐LEO satellite networks

Age-Oriented Access Control in GEO/LEO Heterogeneous Network for Marine IoRT: A Deep Reinforcement Learning Approach

Information Freshness Optimal Resource Allocation for LEO-Satellite Internet of Things

Data Scheduling and Resource Allocation in LEO Satellite Networks for IoT Task Offloading

A Scheduling Scheme for Minimizing Age Under Delay Tolerance in IoT Systems With Heterogeneous Traffic

Collaborative Computing and Resource Allocation for LEO Satellite-Assisted Internet of Things

Robust Task Scheduling for Delay-Aware IoT Applications in Civil Aircraft-Augmented SAGIN

A Hierarchical Resource Scheduling Method for Satellite Control System Based on Deep Reinforcement Learning

Resource Management of GEO Relays for Real-Time Remote Sensing

Energy-Efficient Task Split and Resource Allocation in LEO-Satellite-Assisted IoT Network

Q‐learning based flexible task scheduling in a global view for the Internet of Things

Resource Scheduling for Timely Wireless Powered Crowdsensing with the Aid of Average Age of Information

Age-Optimal Network Coding HARQ Scheme for Satellite-Based Internet of Things

Age-Based Scheduling for Monitoring and Control Applications in Mobile Edge Computing Systems

Age-Optimal Downlink NOMA Resource Allocation for Satellite-Based IoT Network

Machine Learning-Based Resource Allocation in Satellite Networks Supporting Internet of Remote Things

Age-Optimal Mobile Elements Scheduling for Recharging and Data Collection in Green IoT