Abstract:A reconfigurable intelligent surface (RIS)-assisted multi-user downlink communication system over fading channels is investigated, where both non-orthogonal multiple access (NOMA) and orthogonal multiple access (OMA) schemes are employed. In particular, the time overhead for configuring the RIS reflective elements at the beginning of each fading channel is considered. The optimization goal is maximizing the effective throughput of the entire transmission period by jointly optimizing the phase shift of the RIS and the power allocation of the AP for each channel block. In an effort to solve the formulated problem and fill the research vacancy of the performance comparison between different machine learning tools in wireless networks, a deep learning (DL) approach and a reinforcement learning (RL) approach are proposed and their representative superiority and inferiority are investigated. The DL approach can locate the optimal phase shifts with the deep neural network fitting as well as the corresponding power allocation for each user. From the perspective of long-term reward, the phase shift control with configuration overhead can be regarded as a Markov decision process and the RL algorithm is proficient in solving such problems with the assistance of the Bellman equation. The numerical results indicate that: 1) From the perspective of the wireless network, NOMA can achieve a throughput gain of about 42% compared with OMA; 2) The well-trained RL and DL agents are able to achieve the same performance in Rician channel, while RL is superior in the Rayleigh channel; 3) The DL approach has lower complexity and faster convergence, while the RL approach has preferable strategy flexibility.

Channel Assignment for Hybrid NOMA Systems with Deep Reinforcement Learning.

Robust Channel Assignment for Hybrid NOMA Systems with Condition Number Constrainted DRL

Resource Optimisation for Downlink Non-Orthogonal Multiple Access Systems: a Joint Channel Bandwidth and Power Allocations Approach.

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Deep Learning Based Radio Resource Management in NOMA Networks: User Association, Subchannel and Power Allocation

Deep Multi-Task Learning for Cooperative NOMA: System Design and Principles

Power Control, User Scheduling And Resource Allocation For Downlink Noma Systems With Imperfect Channel State Information

Machine Learning Empowered Resource Allocation in IRS Aided MISO-NOMA Networks

AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?

Subchannel Assignment and Power Allocation for NOMA in Spatial Modulation Systems

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Energy-Efficient Resource Allocation in NOMA Heterogeneous Networks.

Resource Allocation for NOMA-Enabled Cognitive Satellite-UAV-Terrestrial Networks with Imperfect CSI

Downlink Non-Orthogonal Multiple Access Power Allocation Algorithm Based on Double Deep Q Network for Ensuring User's Quality of Service

A joint resource optimization allocation algorithm for NOMA‐D2D communication

Joint Queue-Aware and Channel-Aware Scheduling for Non-Orthogonal Multiple Access.

Joint Device Assignment and Power Allocation in Multihoming Heterogeneous Multicarrier NOMA Networks

Dual Dynamic Scheduling for Hierarchical QoS in Uplink-NOMA: A Reinforcement Learning Approach

RL-Assisted Power Allocation for Covert Communication in Distributed NOMA Networks

A Deep Reinforcement Learning based Approach for NOMA-based Random Access Network with Truncated Channel Inversion Power Control

Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach