Abstract:Recently, the reconfigurable intelligent surface (RIS), benefited from the breakthrough on the fabrication of programmable meta-material, has been speculated as one of the key enabling technologies for the future six generation (6G) wireless communication systems scaled up beyond massive multiple input multiple output (Massive-MIMO) technology to achieve smart radio environments. Employed as reflecting arrays, RIS is able to assist MIMO transmissions without the need of radio frequency chains resulting in considerable reduction in power consumption. In this paper, we investigate the joint design of transmit beamforming matrix at the base station and the phase shift matrix at the RIS, by leveraging recent advances in deep reinforcement learning (DRL). We first develop a DRL based algorithm, in which the joint design is obtained through trial-and-error interactions with the environment by observing predefined rewards, in the context of continuous state and action. Unlike the most reported works utilizing the alternating optimization techniques to alternatively obtain the transmit beamforming and phase shifts, the proposed DRL based algorithm obtains the joint design simultaneously as the output of the DRL neural network. Simulation results show that the proposed algorithm is not only able to learn from the environment and gradually improve its behavior, but also obtains the comparable performance compared with two state-of-the-art benchmarks. It is also observed that, appropriate neural network parameter settings will improve significantly the performance and convergence rate of the proposed algorithm.

Hybrid Beamforming for Mmwave MU-MISO Systems Exploiting Multi-Agent Deep Reinforcement Learning

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided Mmwave MIMO Systems

Self-Attention DDPG for Multi-Beam Combining in Mmwave MIMO Systems.

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Self-attention reinforcement learning for multi-beam combining in mmWave 3D-MIMO systems

Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems

Deep Reinforcement Learning for Multi-user Massive MIMO with Channel Aging

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

Fast MIMO Beamforming via Deep Reinforcement Learning for High Mobility mmWave Connectivity

Intelligent flying-beamformer for hybrid mmWave systems: A deep reinforcement learning approach

Hybrid Beamforming for RIS-Empowered Multi-hop Terahertz Communications: A DRL-based Method

A Novel Model-Assisted Decentralized Multi-Agent Reinforcement Learning for Joint Optimization of Hybrid Beamforming in Massive MIMO mmWave Systems

Joint Beamforming Design and Blocklength Optimization for Low-Latency Multi-User MISO URLLC Systems

Deep Reinforcement Learning Based Dynamic Beam Selection in Dual-Band Communication Systems

Robust mmWave Beamforming by Self-Supervised Hybrid Deep Learning

Spectrum-efficient user grouping and resource allocation based on deep reinforcement learning for mmWave massive MIMO-NOMA systems

Deep Reinforcement Learning for Joint Beamwidth and Power Optimization in Mmwave Systems

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

RIS-Aided MmWave Hybrid Relay Network Based on Multi-Agent Deep Reinforcement Learning