Abstract:The integration of terrestrial and satellite wireless communication networks offers a practical solution to enhance network coverage, connectivity, and cost-effectiveness. Moreover, in today’s interconnected world, connectivity’s reliable and widespread availability is increasingly important across various domains. This is especially more crucial for applications like the Internet of Things (IoT), remote sensing, disaster management, and bridging the digital divide. However, allocating the limited network resources efficiently and ensuring seamless handover between satellite and terrestrial networks present significant challenges. Therefore, this study introduces a resource allocation framework for integrated satellite–terrestrial networks to address these challenges. The framework leverages local cache pool deployments and non-orthogonal multiple access (NOMA) to reduce time delays and improve energy efficiency. Our proposed approach utilizes a multi-agent enabled deep deterministic policy gradient algorithm (MADDPG) to optimize user association, cache design, and transmission power control, resulting in enhanced energy efficiency. The approach comprises two phases: User Association and Power Control, where users are treated as agents, and Cache Optimization, where the satellite (Bs) is considered the agent. Through extensive simulations, we demonstrate that our approach surpasses conventional single-agent deep reinforcement learning algorithms in addressing cache design and resource allocation challenges in integrated terrestrial–satellite networks. Specifically, our proposed approach achieves significantly higher energy efficiency and reduced time delays compared to existing methods. This research highlights the importance and addresses the need for efficient resource allocation and cache design in integrated terrestrial–satellite networks, paving the way for enhanced connectivity and improved network performance in various applications.

Multi-Agent DRL for User Association and Power Control in Terrestrial-Satellite Network.

Multi-Agent DRL for Resource Allocation and Cache Design in Terrestrial-Satellite Networks

Dynamic Resource Management in Integrated NOMA Terrestrial-Satellite Networks using Multi-Agent Reinforcement Learning

Dynamic resource management in integrated NOMA terrestrial–satellite networks using multi-agent reinforcement learning

DRL-based Joint Optimization for Energy Efficiency Maximization in DAV-NOMA Networks.

Multi-Agent DRL for Air-to-Ground Communication Planning in UAV-Enabled IoT Networks

Matching Combined Heterogeneous Multi-Agent Reinforcement Learning for Resource Allocation in NOMA-V2X Networks

Multi-Agent DDPG Based Resource Allocation in NOMA-enabled Satellite IoT

Computing Assistance from the Sky: Decentralized Computation Efficiency Optimization for Air-Ground Integrated MEC Networks

A DRL Resource Allocation for Downlink NOMA Multi-beam Satellite Communications.

Multi objective constellation optimization and dynamic link utilization for sustainable information delivery using PD-NOMA deep reinforcement learning

A General DRL-based Optimization Framework of User Association and Power Control for HetNet.

User Pairing for Delay-Limited NOMA-Based Satellite Networks with Deep Reinforcement Learning

Deep Reinforcement Learning Based Resource Allocation for RSMA in LEO Satellite-Terrestrial Networks

Distributed Intelligence: A Verification for Multi-Agent DRL-Based Multibeam Satellite Resource Allocation

An Online Distributed Satellite Cooperative Observation Scheduling Algorithm Based on Multiagent Deep Reinforcement Learning

Deep Reinforcement Learning for Aerial Data Collection in Hybrid-Powered NOMA-IoT Networks

Improved Satellite Resource Allocation Algorithm Based on DRL and MOP

Collaborative Deep Reinforcement Learning for Resource Optimization in Non-Terrestrial Networks

Energy-Efficient Multi-UAVs Cooperative Trajectory Optimization for Communication Coverage: An MADRL Approach

Multi-Agent Deep Reinforcement Learning-Based Flexible Satellite Payload for Mobile Terminals.