Abstract:A reconfigurable intelligent surface (RIS)-assisted multi-user downlink communication system over fading channels is investigated, where both non-orthogonal multiple access (NOMA) and orthogonal multiple access (OMA) schemes are employed. In particular, the time overhead for configuring the RIS reflective elements at the beginning of each fading channel is considered. The optimization goal is maximizing the effective throughput of the entire transmission period by jointly optimizing the phase shift of the RIS and the power allocation of the AP for each channel block. In an effort to solve the formulated problem and fill the research vacancy of the performance comparison between different machine learning tools in wireless networks, a deep learning (DL) approach and a reinforcement learning (RL) approach are proposed and their representative superiority and inferiority are investigated. The DL approach can locate the optimal phase shifts with the deep neural network fitting as well as the corresponding power allocation for each user. From the perspective of long-term reward, the phase shift control with configuration overhead can be regarded as a Markov decision process and the RL algorithm is proficient in solving such problems with the assistance of the Bellman equation. The numerical results indicate that: 1) From the perspective of the wireless network, NOMA can achieve a throughput gain of about 42% compared with OMA; 2) The well-trained RL and DL agents are able to achieve the same performance in Rician channel, while RL is superior in the Rayleigh channel; 3) The DL approach has lower complexity and faster convergence, while the RL approach has preferable strategy flexibility.

Reinforcenment Learning-Aided NOMA Random Access: An AoI-Based Timeliness Perspective

Age-of-Information Dependent Random Access in NOMA-Aided Multiple-Relay Slotted ALOHA

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Age of Information in NOMA-IoT Networks: A Temporal Queuing Model Perspective

Multi-Power Level $Q$-Learning Algorithm for Random Access in NOMA mMTC Systems

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Power-Profile in Q-Learning NOMA Random Access Protocols for Throughput Maximization

Age of Information Analysis for CR-NOMA Aided Uplink Systems with Randomly Arrived Packets

Distributed Age-of-Information Scheduling with NOMA Via Deep Reinforcement Learning

Deep Reinforcement Learning-Based NOMA-Aided Slotted ALOHA for LEO Satellite IoT Networks

Noma/Ca: Noma-Based Random Access With Pattern Detection And Collision Avoidance

AoI-Oriented Resource Allocation for NOMA-Based Wireless Powered Cognitive Radio Networks Based on Multi-Agent Deep Reinforcement Learning

AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?

A Game-Theoretic Approach for NOMA-ALOHA

Deep Reinforcement Learning-Based Power Allocation for Minimizing Age of Information and Energy Consumption in Multi-Input Multi-Output and Non-Orthogonal Multiple Access Internet of Things Systems

Age of Incorrect Information Minimization for Semantic-Empowered NOMA System in S-IoT

Age of Information: Can CR-NOMA Help?

Deep Reinforcement Learning Based Power Allocation for Minimizing AoI and Energy Consumption in MIMO-NOMA IoT Systems

Data-Driven Random Access Optimization in Multi-Cell IoT Networks with NOMA

On the Peak Age of Information in NOMA IoT Networks With Stochastic Arrivals

A Deep Reinforcement Learning based Approach for NOMA-based Random Access Network with Truncated Channel Inversion Power Control