Abstract:Recently, the reconfigurable intelligent surface (RIS), benefited from the breakthrough on the fabrication of programmable meta-material, has been speculated as one of the key enabling technologies for the future six generation (6G) wireless communication systems scaled up beyond massive multiple input multiple output (Massive-MIMO) technology to achieve smart radio environments. Employed as reflecting arrays, RIS is able to assist MIMO transmissions without the need of radio frequency chains resulting in considerable reduction in power consumption. In this paper, we investigate the joint design of transmit beamforming matrix at the base station and the phase shift matrix at the RIS, by leveraging recent advances in deep reinforcement learning (DRL). We first develop a DRL based algorithm, in which the joint design is obtained through trial-and-error interactions with the environment by observing predefined rewards, in the context of continuous state and action. Unlike the most reported works utilizing the alternating optimization techniques to alternatively obtain the transmit beamforming and phase shifts, the proposed DRL based algorithm obtains the joint design simultaneously as the output of the DRL neural network. Simulation results show that the proposed algorithm is not only able to learn from the environment and gradually improve its behavior, but also obtains the comparable performance compared with two state-of-the-art benchmarks. It is also observed that, appropriate neural network parameter settings will improve significantly the performance and convergence rate of the proposed algorithm.

Deep Reinforcement Learning based Downlink Beamforming and Phase Optimization for RIS-Aided Communication System

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

An Efficient Learning Algorithm for Phase Shift Optimization in RIS-Aided MISO Wireless Systems

Secure Beamforming Design for Reconfigurable Intelligent Surface Assisted Downlink Transmission

Distributed DRL based Beamforming Design for RIS-Assisted Multi-cell Systems

Integrated Beamforming and Resource Allocation in RIS-Assisted Mmwave Networks Based on Deep Reinforcement Learning

DRL-Based Beamforming Design in RIS-Aided Multi-user Wireless Networks

Hybrid Beamforming for RIS-Empowered Multi-hop Terahertz Communications: A DRL-based Method

Reconfigurable Intelligent Surface-Enhanced Broadband OFDM Communication Based on Deep Reinforcement Learning

Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems

Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided Mmwave MIMO Systems

Robust Beamforming for RIS-Assisted Wireless Communications with Discrete Phase Shifts.

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Joint Beamforming in RIS-Assisted Multi-User Transmission Design: A Model-Driven Deep Reinforcement Learning Framework

A RIS-Assisted Multiuser MIMO Communication Method Based on Deep Reinforcement Learning

A Deep Reinforcement Learning Approach to Two-Timescale Transmission for RIS-Aided Multiuser MISO Systems

Deep Reinforcement Learning for RIS-aided Multiuser Full-Duplex Secure Communications with Hardware Impairments.

Beamforming Design for Reconfigurable Intelligent Surface Enhanced Full-duplex Ambient Backscatter Communication Networks

Deep Reinforcement Learning for RIS-Assisted FD Systems: Single or Distributed RIS?

Deep Reinforcement Learning Based Power Minimization for RIS-Assisted MISO-OFDM Systems

Piecewise-DRL: Joint Beamforming Optimization for RIS-Assisted MU-MISO Communication System