Abstract:The emerging technology of reconfigurable intelligent surfaces (RISs) is provisioned as an enabler of smart wireless environments, offering a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium, ultimately providing increased environmental intelligence for diverse operation objectives. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces with limited, or even the absence of, computing hardware. In this article, we consider multiuser and multi-RIS-empowered wireless systems and present a thorough survey of the online machine learning approaches for the orchestration of their various tunable components. Focusing on the sum-rate maximization as a representative design objective, we present a comprehensive problem formulation based on deep reinforcement learning (DRL). We detail the correspondences among the parameters of the wireless system and the DRL terminology, and devise generic algorithmic steps for the artificial neural network training and deployment while discussing their implementation details. Further practical considerations for multi-RIS-empowered wireless communications in the sixth-generation (6G) era are presented along with some key open research challenges. Different from the DRL-based status quo, we leverage the independence between the configuration of the system design parameters and the future states of the wireless environment, and present efficient multiarmed bandits approaches, whose resulting sum-rate performances are numerically shown to outperform random configurations, while being sufficiently close to the conventional deep $Q$ network (DQN) algorithm, but with lower implementation complexity.

Gambling on Reconfigurable Intelligent Surfaces

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

Intelligent Spectrum Learning for Wireless Networks with Reconfigurable Intelligent Surfaces.

Fair Non-Orthogonal Multiple Access Communication Systems With Reconfigurable Intelligent Surface

Reconfigurable Intelligent Surface-Assisted Aerial-Terrestrial Communications Via Multi-Task Learning

Reconfigurable Intelligent Computational Surfaces: when Wave Propagation Control Meets Computing

A Deep Reinforcement Learning Approach for Autonomous Reconfigurable Intelligent Surfaces

5 G and beyond wireless network optimization through RIS technology: a pricing game

Opportunistic Reflection in Reconfigurable Intelligent Surface-Assisted Wireless Networks

Pricing for Reconfigurable Intelligent Surface Aided Wireless Networks: Models and Principles

Impact of Inter-Operator Interference via Reconfigurable Intelligent Surfaces

Deep-Learning-Assisted Configuration of Reconfigurable Intelligent Surfaces in Dynamic rich-scattering Environments

Reconfigurable Intelligent Surfaces: Principles and Opportunities

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Memory-Enhanced Dynamic Evolutionary Control of Reconfigurable Intelligent Surfaces

A Survey on Reinforcement Learning for Reconfigurable Intelligent Surfaces in Wireless Communications

Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication

Towards Multi-user Access Fairness in Reconfigurable Intelligent Surface Assisted Wireless Networks

RISnet: A Scalable Approach for Reconfigurable Intelligent Surface Optimization with Partial CSI

Two-Stage Resource Allocation in Reconfigurable Intelligent Surface Assisted Hybrid Networks Via Multi-Player Bandits

Practical Challenges for Reliable RIS Deployment in Heterogeneous Multi-Operator Multi-Band Networks