Abstract:The emerging technology of reconfigurable intelligent surfaces (RISs) is provisioned as an enabler of smart wireless environments, offering a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium, ultimately providing increased environmental intelligence for diverse operation objectives. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces with limited, or even the absence of, computing hardware. In this article, we consider multiuser and multi-RIS-empowered wireless systems and present a thorough survey of the online machine learning approaches for the orchestration of their various tunable components. Focusing on the sum-rate maximization as a representative design objective, we present a comprehensive problem formulation based on deep reinforcement learning (DRL). We detail the correspondences among the parameters of the wireless system and the DRL terminology, and devise generic algorithmic steps for the artificial neural network training and deployment while discussing their implementation details. Further practical considerations for multi-RIS-empowered wireless communications in the sixth-generation (6G) era are presented along with some key open research challenges. Different from the DRL-based status quo, we leverage the independence between the configuration of the system design parameters and the future states of the wireless environment, and present efficient multiarmed bandits approaches, whose resulting sum-rate performances are numerically shown to outperform random configurations, while being sufficiently close to the conventional deep $Q$ network (DQN) algorithm, but with lower implementation complexity.

Dynamic Programmable Wireless Environment with UAV-mounted Static Metasurfaces

UAVs with Reconfigurable Intelligent Surfaces: Applications, Challenges, and Opportunities

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

RIS-aided Wireless Power Transfer for Unmanned Aerial Vehicles

Reconfigurable Intelligent Computational Surfaces: when Wave Propagation Control Meets Computing

Reconfigurable Intelligent Surface-Assisted mmWave multi-UAV Wireless Cellular Networks

A Dual-Band Reconfigurable Intelligent Metasurface with Beam Steering

Reconfigurable Intelligent Surfaces: Design, Implementation, and Practical Demonstration

UAV Swarm-Enabled Aerial Reconfigurable Intelligent Surface (SARIS)

Synergetic UAV-RIS Communication With Highly Directional Transmission

A 2D-programmable and Scalable Reconfigurable Intelligent Surface Remotely Controlled via Digital Infrared Code

Practical Exploration of Reconfigurable Intelligent Surface Deployed in 5G Wireless Environment

Solar Powered UAV-mounted RIS Networks

Hybrid Active-Passive Reconfigurable Intelligent Surface-Assisted UAV Communications.

Active Reconfigurable Intelligent Surface Enhanced Secure and Energy-Efficient Communication of Jittering UAV

Reconfigurable Wireless Relaying With Multi-UAV-Carried Intelligent Reflecting Surfaces

Unmanned Aerial Vehicles Meet Reflective Intelligent Surfaces to Improve Coverage and Secrecy

Modeling and Simulation of Reconfigurable Intelligent Surfaces for Hybrid Aerial and Ground-based Vehicular Communications

Reconfigurable Intelligent Surface Aided Secure UAV Communications

Holography inspired self-controlled reconfigurable intelligent surface

Reflections in the Sky: Joint Trajectory and Passive Beamforming Design for Secure UAV Networks with Reconfigurable Intelligent Surface