Abstract:The emerging technology of reconfigurable intelligent surfaces (RISs) is provisioned as an enabler of smart wireless environments, offering a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium, ultimately providing increased environmental intelligence for diverse operation objectives. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces with limited, or even the absence of, computing hardware. In this article, we consider multiuser and multi-RIS-empowered wireless systems and present a thorough survey of the online machine learning approaches for the orchestration of their various tunable components. Focusing on the sum-rate maximization as a representative design objective, we present a comprehensive problem formulation based on deep reinforcement learning (DRL). We detail the correspondences among the parameters of the wireless system and the DRL terminology, and devise generic algorithmic steps for the artificial neural network training and deployment while discussing their implementation details. Further practical considerations for multi-RIS-empowered wireless communications in the sixth-generation (6G) era are presented along with some key open research challenges. Different from the DRL-based status quo, we leverage the independence between the configuration of the system design parameters and the future states of the wireless environment, and present efficient multiarmed bandits approaches, whose resulting sum-rate performances are numerically shown to outperform random configurations, while being sufficiently close to the conventional deep $Q$ network (DQN) algorithm, but with lower implementation complexity.

LLM Enhanced Reconfigurable Intelligent Surface for Energy-Efficient and Reliable 6G IoV

Air-to-Ground Integrated Internet of Vehicles Enhanced by LAPSs and RISs: Location, Power, and Phase Shift Optimization

Reconfiguring Wireless Environments Via Intelligent Surfaces for 6G: Reflection, Modulation, and Security

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

Deep Learning for Secure Transmission in Reconfigurable Intelligent Surface-Assisted Communications.

Parallel Surfaces: Service-Oriented V2X Communications for Autonomous Vehicles

Spectrum Learning-Aided Reconfigurable Intelligent Surfaces for 'green' 6G Networks

Enhanced Reconfigurable Intelligent Surface Assisted Mmwave Communication: A Federated Learning Approach

Intelligent Spectrum Learning for Wireless Networks with Reconfigurable Intelligent Surfaces.

Reconfigurable Intelligent Surface-Assisted Aerial-Terrestrial Communications Via Multi-Task Learning

Reconfigurable Intelligent Surface Enhanced Massive IoT Systems with Nonlinear Measurements

Reconfigurable Intelligent Surfaces: Principles and Opportunities

Reconfigurable Intelligent Surfaces for Smart Wireless Environments: Channel Estimation, System Design and Applications in 6G Networks

Intelligent Surface Aided D2D-V2X System for Low-Latency and High-Reliability Communications.

An Integrated Sensing and Communication Architecture Using Reconfigurable Intelligent Surfaces for 6G Wireless Networks

Reconfigurable Intelligent Surface (RIS)-aided Vehicular Networks: Their Protocols, Resource Allocation, and Performance

Reconfigurable Intelligent Surfaces for 6G Mobile Networks: An Industry R&D Perspective

Applications and challenges of Reconfigurable Intelligent Surface for 6G networks

Reconfigurable Intelligent Surfaces for Wireless Communications: Overview of Hardware Designs, Channel Models, and Estimation Techniques

Leveraging AI and Intelligent Reflecting Surface for Energy-Efficient Communication in 6G IoT

Special Issue on Reconfigurable Intelligent Surface for B5G & 6G