Abstract:The emerging technology of reconfigurable intelligent surfaces (RISs) is provisioned as an enabler of smart wireless environments, offering a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium, ultimately providing increased environmental intelligence for diverse operation objectives. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces with limited, or even the absence of, computing hardware. In this article, we consider multiuser and multi-RIS-empowered wireless systems and present a thorough survey of the online machine learning approaches for the orchestration of their various tunable components. Focusing on the sum-rate maximization as a representative design objective, we present a comprehensive problem formulation based on deep reinforcement learning (DRL). We detail the correspondences among the parameters of the wireless system and the DRL terminology, and devise generic algorithmic steps for the artificial neural network training and deployment while discussing their implementation details. Further practical considerations for multi-RIS-empowered wireless communications in the sixth-generation (6G) era are presented along with some key open research challenges. Different from the DRL-based status quo, we leverage the independence between the configuration of the system design parameters and the future states of the wireless environment, and present efficient multiarmed bandits approaches, whose resulting sum-rate performances are numerically shown to outperform random configurations, while being sufficiently close to the conventional deep $Q$ network (DQN) algorithm, but with lower implementation complexity.

RIS-Aware Indoor Network Planning: The Rennes Railway Station Case

Unlocking Metasurface Practicality for B5G Networks: AI-assisted RIS Planning

RIS-Enabled Smart Wireless Environments: Deployment Scenarios, Network Architecture, Bandwidth and Area of Influence

Arbitrary Beam Pattern Approximation via RISs with Measured Element Responses

Reconfiguring Wireless Environments Via Intelligent Surfaces for 6G: Reflection, Modulation, and Security

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

RIS-aided Positioning Experiments based on mmWave Indoor Channel Measurements

Distributed RIS-Enhanced Cell-Free NOMA Networks

Enhanced 5G/B5G Network Planning/Optimization deploying RIS in Urban/Outdoor Scenarios

Reconfigurable Intelligent Surface-Assisted Aerial-Terrestrial Communications Via Multi-Task Learning

Network-Independent and User-Controlled RIS: An Experimental Perspective

Planning Mm-Wave Access Networks With Reconfigurable Intelligent Surfaces

Reconfigurable Intelligent Surfaces: Performance Assessment Through a System-Level Simulator

Electric Field Evaluation of Reconfigurable Intelligent Surface in Wireless Networks

Smart Radio Environments Empowered by Reconfigurable Intelligent Surfaces: How It Works, State of Research, and The Road Ahead

RIS-Aided Wireless Communications: Prototyping, Adaptive Beamforming, and Indoor/Outdoor Field Trials

Modeling and Simulation of Reconfigurable Intelligent Surfaces for Hybrid Aerial and Ground-based Vehicular Communications

Practical Challenges for Reliable RIS Deployment in Heterogeneous Multi-Operator Multi-Band Networks

Prototyping and real-world field trials of RIS-aided wireless communications

Reconfigurable Intelligent Surfaces: Principles and Opportunities