Abstract:Satellite networks have been regarded as a promising architecture for supporting the Internet of remote things (IoRT) due to their advantages of wide coverage and high communication capacity in remote areas, which further promotes the development of the satellites for IoRT networks (SIoRTNs). The effectiveness of multi-dimensional resource collaboration has significant impacts on the IoRT data downloading performance. However, the environment ' s dynamics, e.g., channel conditions and solar infeed process, are unknown in practical scenarios, which poses daunting challenges in making efficient utilization of multi-dimensional resources. Motivated by this fact, we model the joint resource scheduling and IoRT data scheduling problem with the aim of maximizing the amount of the IoRT data of the overall network by applying the model-free reinforcement learning framework. To overcome the limitations of traditional reinforcement learning algorithms, we propose several feature functions by investigating the natural attributes of the multi-dimensional resources of the SIoRTNs, and further exploit the concept of function approximation to approximate the expected downloaded IoRT data given the network state. Furthermore, we propose a state-action-reward-state-action (SARSA) based actor-critic reinforcement learning (SACRL) resource allocation strategy to achieve the optimal resource allocation and IoRT data scheduling with casual information at LEO satellites. Simulations validate the convergence property and the effectiveness of the proposed SACRL algorithm in terms of the amount of the downloaded IoRT data. Particularly, we investigate the impact of typical network parameters on network performance to further provide guidance for future SIoRTN system design.

Age-oriented Access Control in GEO/LEO Heterogeneous Network for Marine IoRT.

Age-Oriented Access Control in GEO/LEO Heterogeneous Network for Marine IoRT: A Deep Reinforcement Learning Approach

Harmony or Involution: Game Inspiring Age-of-Information Optimization for Edge Data Gathering in Internet of Things

Age-Aware Task Scheduling Scheme in Hybrid GEO-LEO Satellite Networks

Intelligent Task Scheduling in Hybrid GEO-LEO Satellite-Assisted Marine IoT Network

Grant Free Age-Optimal Random Access Protocol for Satellite-Based Internet of Things

Cooperative user association and resource allocation for task offloading in hybrid GEO‐LEO satellite networks

Age-Optimal Multi-Slot Pilot Allocation Random Access Protocol for S-IoT

Information Freshness Optimal Resource Allocation for LEO-Satellite Internet of Things

Machine Learning-Based Resource Allocation in Satellite Networks Supporting Internet of Remote Things

Collaborative Computing and Resource Allocation for LEO Satellite-Assisted Internet of Things

A Survey on Random Access Protocols in Direct-Access LEO Satellite-Based IoT Communication

AoTP: an Age-Optimal Transport Protocol for Satellite-Integrated Internet

Load-Aware Network Resource Orchestration in LEO Satellite Network: A GAT-Based Approach

Resource Management of GEO Relays for Real-Time Remote Sensing

Service-Oriented AoI Modeling and Analysis for Non-Terrestrial Networks

Deep Reinforcement Learning-Assisted NOMA Age-Optimal Power Allocation for S-IoT Network

Age-Optimal Downlink NOMA Resource Allocation for Satellite-Based IoT Network

Analysis of Age of Information in Non-terrestrial Networks

AoI-Aware UAV-Enabled Marine MEC Networks with Integrated Sensing, Computation, and Communication.