Abstract:The emerging technology of reconfigurable intelligent surfaces (RISs) is provisioned as an enabler of smart wireless environments, offering a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium, ultimately providing increased environmental intelligence for diverse operation objectives. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces with limited, or even the absence of, computing hardware. In this article, we consider multiuser and multi-RIS-empowered wireless systems and present a thorough survey of the online machine learning approaches for the orchestration of their various tunable components. Focusing on the sum-rate maximization as a representative design objective, we present a comprehensive problem formulation based on deep reinforcement learning (DRL). We detail the correspondences among the parameters of the wireless system and the DRL terminology, and devise generic algorithmic steps for the artificial neural network training and deployment while discussing their implementation details. Further practical considerations for multi-RIS-empowered wireless communications in the sixth-generation (6G) era are presented along with some key open research challenges. Different from the DRL-based status quo, we leverage the independence between the configuration of the system design parameters and the future states of the wireless environment, and present efficient multiarmed bandits approaches, whose resulting sum-rate performances are numerically shown to outperform random configurations, while being sufficiently close to the conventional deep $Q$ network (DQN) algorithm, but with lower implementation complexity.

DRL-Based Sidelobe Suppression for Multi-focus Reconfigurable Intelligent Surface

Indoor Signal Focusing with Deep Learning Designed Reconfigurable Intelligent Surfaces

A DRL-based Reflection Enhancement Method for RIS-assisted Multi-receiver Communications

Deep Learning for Secure Transmission in Reconfigurable Intelligent Surface-Assisted Communications.

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

Hybrid Beamforming for RIS-Empowered Multi-hop Terahertz Communications: A DRL-based Method

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

Beamforming Design for Reconfigurable Intelligent Surface Enhanced Full-duplex Ambient Backscatter Communication Networks

Intelligent Spectrum Learning for Wireless Networks with Reconfigurable Intelligent Surfaces.

Optimal Control for Full-Duplex Communications with Reconfigurable Intelligent Surface

Secure Beamforming Design for Reconfigurable Intelligent Surface Assisted Downlink Transmission

Deep Reinforcement Learning based Downlink Beamforming and Phase Optimization for RIS-Aided Communication System

Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems

Fairness-Driven Optimization of RIS-Augmented 5G Networks for Seamless 3D UAV Connectivity Using DRL Algorithms

Design of Dynamic Active‐passive Beamforming for Reconfigurable Intelligent Surfaces Assisted Hybrid VLC/RF Communications

Active Reconfigurable Intelligent Surface-Assisted Mainlobe Wideband RFI Mitigation With Deep Reinforcement Learning for a Large Reflector Antenna

Special Issue on Reconfigurable Intelligent Surface for B5G & 6G

On the Design of Broadbeam of Reconfigurable Intelligent Surface

RIS Subarray Optimization with Reinforcement Learning for Green Symbiotic Communications in Internet of Things

Deep Inverse Design of Reconfigurable Metasurfaces for Future Communications