Abstract:A reconfigurable intelligent surface (RIS)-assisted multi-user downlink communication system over fading channels is investigated, where both non-orthogonal multiple access (NOMA) and orthogonal multiple access (OMA) schemes are employed. In particular, the time overhead for configuring the RIS reflective elements at the beginning of each fading channel is considered. The optimization goal is maximizing the effective throughput of the entire transmission period by jointly optimizing the phase shift of the RIS and the power allocation of the AP for each channel block. In an effort to solve the formulated problem and fill the research vacancy of the performance comparison between different machine learning tools in wireless networks, a deep learning (DL) approach and a reinforcement learning (RL) approach are proposed and their representative superiority and inferiority are investigated. The DL approach can locate the optimal phase shifts with the deep neural network fitting as well as the corresponding power allocation for each user. From the perspective of long-term reward, the phase shift control with configuration overhead can be regarded as a Markov decision process and the RL algorithm is proficient in solving such problems with the assistance of the Bellman equation. The numerical results indicate that: 1) From the perspective of the wireless network, NOMA can achieve a throughput gain of about 42% compared with OMA; 2) The well-trained RL and DL agents are able to achieve the same performance in Rician channel, while RL is superior in the Rayleigh channel; 3) The DL approach has lower complexity and faster convergence, while the RL approach has preferable strategy flexibility.

Adaptive Modulation Scheme for Satellite Communication Channel Based on RLNN

Wireless Channel Prediction for Multi-user Physical Layer with Deep Reinforcement Learning

A Satellite Adaptive Modulation Coding Method Based on Deep Reinforcement Learning

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Efficient Communications for Multi-Agent Reinforcement Learning in Wireless Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Energy-efficient traffic offloading for RSMA-based hybrid satellite terrestrial networks with deep reinforcement learning

Application of deep neural network and deep reinforcement learning in wireless communication

Adaptive Modulation and Coding for Underwater Acoustic Communication Based on Neural Networks

Offline Reinforcement Learning and Sequence Modeling for Downlink Link Adaptation

Safe Multi-Agent Reinforcement Learning for Wireless Applications Against Adversarial Communications

Survey on Reinforcement Learning Applications in Communication Networks.

Efficient Communications in Multi-Agent Reinforcement Learning for Mobile Applications

AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?

Dynamic Resource Allocation With Deep Reinforcement Learning in Multibeam Satellite Communication

Energy Efficiency Optimization for Subterranean LoRaWAN Using A Reinforcement Learning Approach: A Direct-to-Satellite Scenario

Dynamic Spectrum Sharing Based on Deep Reinforcement Learning in Mobile Communication Systems

Multi-Agent Deep Reinforcement Learning Based Channel Allocation for Networked Satellite Telemetry System.

Integrating LEO Satellite and UAV Relaying via Reinforcement Learning for Non-Terrestrial Networks

Low Risk Antenna Configurations for Mobile Communication Systems: A Safe Reinforcement Learning Method