Abstract:The emerging technology of reconfigurable intelligent surfaces (RISs) is provisioned as an enabler of smart wireless environments, offering a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium, ultimately providing increased environmental intelligence for diverse operation objectives. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces with limited, or even the absence of, computing hardware. In this article, we consider multiuser and multi-RIS-empowered wireless systems and present a thorough survey of the online machine learning approaches for the orchestration of their various tunable components. Focusing on the sum-rate maximization as a representative design objective, we present a comprehensive problem formulation based on deep reinforcement learning (DRL). We detail the correspondences among the parameters of the wireless system and the DRL terminology, and devise generic algorithmic steps for the artificial neural network training and deployment while discussing their implementation details. Further practical considerations for multi-RIS-empowered wireless communications in the sixth-generation (6G) era are presented along with some key open research challenges. Different from the DRL-based status quo, we leverage the independence between the configuration of the system design parameters and the future states of the wireless environment, and present efficient multiarmed bandits approaches, whose resulting sum-rate performances are numerically shown to outperform random configurations, while being sufficiently close to the conventional deep $Q$ network (DQN) algorithm, but with lower implementation complexity.

Generalized Spatial Modulation Detector Assisted by Reconfigurable Intelligent Surface Based on Deep Learning

Deep Learning Based Detection on RIS Assisted RSM and RSSK Techniques

Deep Learning for Secure Transmission in Reconfigurable Intelligent Surface-Assisted Communications.

Intelligent Spectrum Learning for Wireless Networks with Reconfigurable Intelligent Surfaces.

Indoor Signal Focusing with Deep Learning Designed Reconfigurable Intelligent Surfaces

Reconfigurable Intelligent Surface Enhanced Massive IoT Systems with Nonlinear Measurements

Block Deep Neural Network-Based Signal Detector for Generalized Spatial Modulation

Rectangular Differential Reflecting Spatial Modulation: A Noncoherent Joint Index-Modulation of RIS-assisted MIMO System

RIS-based Opposite Phase Index Modulation and Its DNN-assisted Joint Sequence Detection

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

Secure Energy Efficiency in Communication Systems Based on Deep Learning

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

A Deep-learning-based Joint Inference for Secure Spatial Modulation Receiver

Deep-Learning Based Reconfigurable Intelligent Surfaces for Intervehicular Communication

A Simple Detection and Identification Scheme For Reconfigurable Intelligent Surfaces

Deep Learning Optimized Sparse Antenna Activation for Reconfigurable Intelligent Surface Assisted Communication

Deep Convolutional and Recurrent Neural-Network-Based Optimal Decoding for RIS-Assisted MIMO Communication

RIS-Assisted Generalized Receive Quadrature Spatial Modulation

AI-Empowered RIS-Assisted Networks: CV-Enabled RIS Selection and DNN-Enabled Transmission

RIS-Aided Receive Generalized Spatial Modulation Design with Reflecting Modulation

Reconfigurable Intelligent Surface Enhanced Device-to-Device Communications