Abstract:A reconfigurable intelligent surface (RIS) aided air-to-ground uplink non-orthogonal transmission framework is investigated for next generation multiple access. Occupying the same spectrum resource, unmanned aerial vehicle (UAV) users and ground users (GUs) are connected to terrestrial cellular networks via the uplink non-orthogonal multiple access (NOMA) protocol. As the flight safety is important for employing UAVs in civil airspace, the collision avoidance mechanism has to be considered during the flight. Therefore, a joint optimization problem of the UAV trajectory design, RIS configuration, and uploading power control is formulated for maximizing the network sum rate, while ensuring the UAV’s fight safety and satisfying the minimum data rate requirements of both the UAV and GU. The resultant problem is a sequential decision making one across multiple coherent time slots. Besides, the unknown locations of obstacles bring uncertainties into the decision making process. To tackle this challenging problem, a sample-efficient deep reinforcement learning (DRL) algorithm is proposed to optimize the UAV trajectory, RIS configuration, and power control simultaneously. Moreover, considering the ambiguous uncertainties in the environment, a distributionally robust DRL algorithm is further proposed to provide the worst-case performance guarantee. Numerical results demonstrate that the two proposed DRL algorithms outperform the conventional ones in terms of learning efficiency and robustness. It is also shown that the network sum rate is significantly improved by the proposed RIS-NOMA scheme compared to the conventional RIS-orthogonal multiple access (OMA) scheme and the case where no RIS is deployed.

Reinforcement Learning for User Clustering in NOMA-Enabled Uplink IoT.

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Deep Reinforcement Learning for Uplink Scheduling in NOMA-URLLC Networks

AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Machine Learning Empowered Resource Allocation in IRS Aided MISO-NOMA Networks

Joint User Clustering And Passive Beamforming For Downlink Noma System With Reconfigurable Intelligent Surface

Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

A novel user clustering and efficient resource allocation in non-orthogonal mutliple access for IoT networks

RIS-Aided Ground-Aerial NOMA Communications: A Distributionally Robust DRL Approach

Active RIS-aided EH-NOMA Networks: A Deep Reinforcement Learning Approach

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Dual Dynamic Scheduling for Hierarchical QoS in Uplink-NOMA: A Reinforcement Learning Approach

Resource Allocation in IRSs Aided MISO-NOMA Networks: A Machine Learning Approach.

A Multi-Agent Reinforcement Learning Approach for Massive Access in NOMA-URLLC Networks

Deep Learning Based Radio Resource Management in NOMA Networks: User Association, Subchannel and Power Allocation

AoI-Oriented Resource Allocation for NOMA-Based Wireless Powered Cognitive Radio Networks Based on Multi-Agent Deep Reinforcement Learning

Deep Reinforcement Learning for Radio Resource Allocation in NOMA-based Remote State Estimation

Design Optimization of NOMA Aided Multi-STAR-RIS for Indoor Environments: A Convex Approximation Imitated Reinforcement Learning Approach

Deep Reinforcement Learning-Based NOMA-Aided Slotted ALOHA for LEO Satellite IoT Networks