Abstract:Recently, the reconfigurable intelligent surface (RIS), benefited from the breakthrough on the fabrication of programmable meta-material, has been speculated as one of the key enabling technologies for the future six generation (6G) wireless communication systems scaled up beyond massive multiple input multiple output (Massive-MIMO) technology to achieve smart radio environments. Employed as reflecting arrays, RIS is able to assist MIMO transmissions without the need of radio frequency chains resulting in considerable reduction in power consumption. In this paper, we investigate the joint design of transmit beamforming matrix at the base station and the phase shift matrix at the RIS, by leveraging recent advances in deep reinforcement learning (DRL). We first develop a DRL based algorithm, in which the joint design is obtained through trial-and-error interactions with the environment by observing predefined rewards, in the context of continuous state and action. Unlike the most reported works utilizing the alternating optimization techniques to alternatively obtain the transmit beamforming and phase shifts, the proposed DRL based algorithm obtains the joint design simultaneously as the output of the DRL neural network. Simulation results show that the proposed algorithm is not only able to learn from the environment and gradually improve its behavior, but also obtains the comparable performance compared with two state-of-the-art benchmarks. It is also observed that, appropriate neural network parameter settings will improve significantly the performance and convergence rate of the proposed algorithm.

An Efficient Learning Algorithm for Phase Shift Optimization in RIS-Aided MISO Wireless Systems

Deep Reinforcement Learning based Downlink Beamforming and Phase Optimization for RIS-Aided Communication System

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Piecewise-DRL: Joint Beamforming Optimization for RIS-Assisted MU-MISO Communication System

Secure Beamforming Design for Reconfigurable Intelligent Surface Assisted Downlink Transmission

DRL-based Max-Min Fair RIS Discrete Phase Shift Optimization for MISO-OFDM Systems

Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems

Low-Complexity Joint Beamforming for RIS-Assisted MU-MISO Systems Based on Model-Driven Deep Learning

Integrated Beamforming and Resource Allocation in RIS-Assisted Mmwave Networks Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Power Minimization for RIS-Assisted MISO-OFDM Systems

A Deep Reinforcement Learning Approach to Two-Timescale Transmission for RIS-Aided Multiuser MISO Systems

Robust Beamforming for RIS-Assisted Wireless Communications with Discrete Phase Shifts.

Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided Mmwave MIMO Systems

A RIS-Assisted Multiuser MIMO Communication Method Based on Deep Reinforcement Learning

Joint Beamforming in RIS-Assisted Multi-User Transmission Design: A Model-Driven Deep Reinforcement Learning Framework

Distributed DRL based Beamforming Design for RIS-Assisted Multi-cell Systems

Fair Non-Orthogonal Multiple Access Communication Systems With Reconfigurable Intelligent Surface

DRL-Based RIS Phase Shift Design for OFDM Communication Systems.

An MRL-Based Design Solution for RIS-Assisted MU-MIMO Wireless System under Time-Varying Channels

Reconfigurable Intelligent Surface-Enhanced Broadband OFDM Communication Based on Deep Reinforcement Learning