Abstract:The integration of terrestrial and satellite wireless communication networks offers a practical solution to enhance network coverage, connectivity, and cost-effectiveness. Moreover, in today’s interconnected world, connectivity’s reliable and widespread availability is increasingly important across various domains. This is especially more crucial for applications like the Internet of Things (IoT), remote sensing, disaster management, and bridging the digital divide. However, allocating the limited network resources efficiently and ensuring seamless handover between satellite and terrestrial networks present significant challenges. Therefore, this study introduces a resource allocation framework for integrated satellite–terrestrial networks to address these challenges. The framework leverages local cache pool deployments and non-orthogonal multiple access (NOMA) to reduce time delays and improve energy efficiency. Our proposed approach utilizes a multi-agent enabled deep deterministic policy gradient algorithm (MADDPG) to optimize user association, cache design, and transmission power control, resulting in enhanced energy efficiency. The approach comprises two phases: User Association and Power Control, where users are treated as agents, and Cache Optimization, where the satellite (Bs) is considered the agent. Through extensive simulations, we demonstrate that our approach surpasses conventional single-agent deep reinforcement learning algorithms in addressing cache design and resource allocation challenges in integrated terrestrial–satellite networks. Specifically, our proposed approach achieves significantly higher energy efficiency and reduced time delays compared to existing methods. This research highlights the importance and addresses the need for efficient resource allocation and cache design in integrated terrestrial–satellite networks, paving the way for enhanced connectivity and improved network performance in various applications.

Multi-Agent DDPG Based Resource Allocation in NOMA-enabled Satellite IoT

Matching Combined Heterogeneous Multi-Agent Reinforcement Learning for Resource Allocation in NOMA-V2X Networks

Multi-Agent DRL for Resource Allocation and Cache Design in Terrestrial-Satellite Networks

Dynamic resource management in integrated NOMA terrestrial–satellite networks using multi-agent reinforcement learning

Dynamic Resource Management in Integrated NOMA Terrestrial-Satellite Networks using Multi-Agent Reinforcement Learning

Multi - Agent Deep Deterministic Policy Gradient Based Satellite Spectrum/Code Resource Scheduling with Multi-constraint

A Partially Observable Deep Multi-Agent Active Inference Framework for Resource Allocation in 6G and Beyond Wireless Communications Networks

Multi-Agent DRL for User Association and Power Control in Terrestrial-Satellite Network.

Resource Scheduling for NOMA-Based Mobile Phones and IoT Fusion Satellite Network

Resource Allocation for NOMA Based Space-Terrestrial Satellite Networks

A DRL Resource Allocation for Downlink NOMA Multi-beam Satellite Communications.

Network Utility Maximization Resource Allocation for NOMA in Satellite-Based Internet of Things

Resource Allocation for NOMA-enabled Satellite- Terrestrial Networks

Age-Optimal Downlink NOMA Resource Allocation for Satellite-Based IoT Network

Deep Learning-Based Long-Term Power Allocation Scheme for NOMA Downlink System in S-IoT

Deep Reinforcement Learning-Assisted NOMA Age-Optimal Power Allocation for S-IoT Network

Resource Allocation for NOMA-Enabled Cognitive Satellite-UAV-Terrestrial Networks with Imperfect CSI

Robust Resource Allocation for Lightweight Secure Transmission in Multicarrier NOMA-Assisted Full Duplex IoT Networks

Resource Allocation in Terrestrial-Satellite-Based Next Generation Multiple Access Networks With Interference Cooperation

Resource Allocation for Cognitive Satellite-HAP-Terrestrial Networks With Non-Orthogonal Multiple Access

Dynamic Divide Grouping Non-Orthogonal Multiple Access in Terrestrial-Satellite Integrated Network.