Abstract:Abstract To achieve a green and sustainable wireless communication network, the reconfigurable intelligent surface (RIS) technology has emerged as an emerging technology. The RIS-assisted mmWave massive MIMO vehicle-to-everything (V2X) communications can support enhanced V2X applications for connected and automated vehicles. The design of RIS-assisted mmWave V2X communications is though not exempt of challenges as a result of fast time-varying propagation and highly dynamic vehicular networks and topologies. To address some of these challenges, we propose an attention-deep reinforcement learning jointly beamforming based on tensor decomposition for RIS-assisted mmWave massive MIMO system to improving the safety and traffic efficiency of cooperative automated driving. The received signal of the vehicle is decomposed into four-dimensional tensors and study the channel, frequency and time attention (CFTA) algorithm using the low order tensor characteristics of mmWave channels. This algorithm can extract the frequency and time characteristics of the channel, and obtain the millimeter wave characteristic channel between the corresponding base station (BS) and the vehicles. The problem of jointly optimization of beamforming matrix at the BS and the phase shift matrix on the RIS is constructed and solved using deep reinforcement learning (DRL). Unlike traditional alternating optimization methods, the integration of DRL techniques into the optimal design of the system enables the observation of immediate rewards, learning from the environment and improving it to obtain optimal solutions to high-dimensional jointly beamforming optimization problems ultimately. The simulation results show that the proposed algorithm has meaningful performance compared with other methods.

Integrated Beamforming and Resource Allocation in RIS-Assisted Mmwave Networks Based on Deep Reinforcement Learning

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems

Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided Mmwave MIMO Systems

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Hybrid Beamforming for RIS-Empowered Multi-hop Terahertz Communications: A DRL-based Method

DRL-based Joint Beamforming and BS-RIS-UE Association Design for RIS-Assisted mmWave Networks

Deep Reinforcement Learning based Downlink Beamforming and Phase Optimization for RIS-Aided Communication System

Beamforming Design for Multiuser Transmission Through Reconfigurable Intelligent Surface.

An MRL-Based Design Solution for RIS-Assisted MU-MIMO Wireless System under Time-Varying Channels

Secure Beamforming Design for Reconfigurable Intelligent Surface Assisted Downlink Transmission

Attention-deep reinforcement learning jointly beamforming based on tensor decomposition for RIS-assisted V2X mmWave massive MIMO system

Robust Beamforming for RIS-Assisted Wireless Communications with Discrete Phase Shifts.

RIS-Enhanced WPCNs: Joint Radio Resource Allocation and Passive Beamforming Optimization

Low-Complexity Joint Beamforming for RIS-Assisted MU-MISO Systems Based on Model-Driven Deep Learning

Energy Efficient Rate Splitting Multiple Access (RSMA) with Reconfigurable Intelligent Surface.

Beam Selection for RIS-Enabled Terahertz Multi-User MIMO Systems via Multi-Task Learning

Deep Reinforcement Learning for RIS-Assisted FD Systems: Single or Distributed RIS?

Multi-Hop RIS-Empowered Terahertz Communications: A DRL-Based Hybrid Beamforming Design

Wideband Beamforming for RIS Assisted Near-Field Communications

Multi-user mmWave Uplink Communications based on Collaborative Double-RIS: Joint Beamforming and Power Control