Abstract:The integration of terrestrial and satellite wireless communication networks offers a practical solution to enhance network coverage, connectivity, and cost-effectiveness. Moreover, in today’s interconnected world, connectivity’s reliable and widespread availability is increasingly important across various domains. This is especially more crucial for applications like the Internet of Things (IoT), remote sensing, disaster management, and bridging the digital divide. However, allocating the limited network resources efficiently and ensuring seamless handover between satellite and terrestrial networks present significant challenges. Therefore, this study introduces a resource allocation framework for integrated satellite–terrestrial networks to address these challenges. The framework leverages local cache pool deployments and non-orthogonal multiple access (NOMA) to reduce time delays and improve energy efficiency. Our proposed approach utilizes a multi-agent enabled deep deterministic policy gradient algorithm (MADDPG) to optimize user association, cache design, and transmission power control, resulting in enhanced energy efficiency. The approach comprises two phases: User Association and Power Control, where users are treated as agents, and Cache Optimization, where the satellite (Bs) is considered the agent. Through extensive simulations, we demonstrate that our approach surpasses conventional single-agent deep reinforcement learning algorithms in addressing cache design and resource allocation challenges in integrated terrestrial–satellite networks. Specifically, our proposed approach achieves significantly higher energy efficiency and reduced time delays compared to existing methods. This research highlights the importance and addresses the need for efficient resource allocation and cache design in integrated terrestrial–satellite networks, paving the way for enhanced connectivity and improved network performance in various applications.

Multi-agent Deep Reinforcement Learning Based Resource Management in IRS-NOMA Terahertz Network.

Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications

AoI-Oriented Resource Allocation for NOMA-Based Wireless Powered Cognitive Radio Networks Based on Multi-Agent Deep Reinforcement Learning

Matching Combined Heterogeneous Multi-Agent Reinforcement Learning for Resource Allocation in NOMA-V2X Networks

Dynamic resource management in integrated NOMA terrestrial–satellite networks using multi-agent reinforcement learning

Power Allocation and Passive Beamforming Design for RIS Aided NOMA in THz Communications

Graph-Embedded Multi-Agent Learning for Smart Reconfigurable THz MIMO-NOMA Networks

Dynamic Resource Management in Integrated NOMA Terrestrial-Satellite Networks using Multi-Agent Reinforcement Learning

Joint Phase Shift Design and Resource Management for a Non-Orthogonal Multiple Access-Enhanced Internet of Vehicle Assisted by an Intelligent Reflecting Surface-Equipped Unmanned Aerial Vehicle

Multi-Agent Deep Reinforcement Learning for Massive Access in 5G and Beyond Ultra-Dense NOMA System

Resource Allocation for Multi-Cell IRS-Aided NOMA Networks

Multi-Task Deep Reinforcement Learning for Terahertz NOMA Resource Allocation with Hybrid Discrete and Continuous Actions

Machine Learning Empowered Resource Allocation in IRS Aided MISO-NOMA Networks

Deep Reinforcement Learning Method for Energy Efficient Resource Allocation in Next Generation Wireless Networks.

Intelligent Reflecting Surface Aided Multi-Cell NOMA Networks

Resource Allocation for IRS Assisted SGF NOMA Transmission: A MADRL Approach

A Multi-Agent Reinforcement Learning Approach for Massive Access in NOMA-URLLC Networks

Resource Allocation in IRSs Aided MISO-NOMA Networks: A Machine Learning Approach.

Resource Allocation in Uplink NOMA Systems: A Hybrid-Decision-Based Multi-Agent Deep Reinforcement Learning Approach

Energy-Efficient Resource Management for Multi-UAV NOMA Networks Based on Deep Reinforcement Learning

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach