Abstract:A reconfigurable intelligent surface (RIS) aided air-to-ground uplink non-orthogonal transmission framework is investigated for next generation multiple access. Occupying the same spectrum resource, unmanned aerial vehicle (UAV) users and ground users (GUs) are connected to terrestrial cellular networks via the uplink non-orthogonal multiple access (NOMA) protocol. As the flight safety is important for employing UAVs in civil airspace, the collision avoidance mechanism has to be considered during the flight. Therefore, a joint optimization problem of the UAV trajectory design, RIS configuration, and uploading power control is formulated for maximizing the network sum rate, while ensuring the UAV’s fight safety and satisfying the minimum data rate requirements of both the UAV and GU. The resultant problem is a sequential decision making one across multiple coherent time slots. Besides, the unknown locations of obstacles bring uncertainties into the decision making process. To tackle this challenging problem, a sample-efficient deep reinforcement learning (DRL) algorithm is proposed to optimize the UAV trajectory, RIS configuration, and power control simultaneously. Moreover, considering the ambiguous uncertainties in the environment, a distributionally robust DRL algorithm is further proposed to provide the worst-case performance guarantee. Numerical results demonstrate that the two proposed DRL algorithms outperform the conventional ones in terms of learning efficiency and robustness. It is also shown that the network sum rate is significantly improved by the proposed RIS-NOMA scheme compared to the conventional RIS-orthogonal multiple access (OMA) scheme and the case where no RIS is deployed.

Robust Channel Assignment for Hybrid NOMA Systems with Condition Number Constrainted DRL

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Robust and Outage-Constrained Energy Efficiency Optimization in RIS-Assisted NOMA Networks

Power Control, User Scheduling And Resource Allocation For Downlink Noma Systems With Imperfect Channel State Information

AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?

Energy-Efficient Resource Allocation with Imperfect CSI in NOMA-based D2D Networks with SWIPT

Dual Dynamic Scheduling for Hierarchical QoS in Uplink-NOMA: A Reinforcement Learning Approach

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

RIS-Aided Ground-Aerial NOMA Communications: A Distributionally Robust DRL Approach

Machine Learning Empowered Resource Allocation in IRS Aided MISO-NOMA Networks

Joint Resource Management for MC-NOMA: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Uplink Scheduling in NOMA-URLLC Networks

A Multi-Agent Reinforcement Learning Approach for Massive Access in NOMA-URLLC Networks

Robust Resource Allocation for Lightweight Secure Transmission in Multicarrier NOMA-Assisted Full Duplex IoT Networks

A Deep Reinforcement Learning based Approach for NOMA-based Random Access Network with Truncated Channel Inversion Power Control

RL-Assisted Power Allocation for Covert Communication in Distributed NOMA Networks

Reinforcement Learning for User Clustering in NOMA-Enabled Uplink IoT.

Resource Allocation for NOMA-Enabled Cognitive Satellite-UAV-Terrestrial Networks with Imperfect CSI

Resource Allocation in IRSs Aided MISO-NOMA Networks: A Machine Learning Approach.

Active RIS-aided EH-NOMA Networks: A Deep Reinforcement Learning Approach

A Hybrid Optimization and Deep RL Approach for Resource Allocation in Semi-GF NOMA Networks