Abstract:Abstract To achieve a green and sustainable wireless communication network, the reconfigurable intelligent surface (RIS) technology has emerged as an emerging technology. The RIS-assisted mmWave massive MIMO vehicle-to-everything (V2X) communications can support enhanced V2X applications for connected and automated vehicles. The design of RIS-assisted mmWave V2X communications is though not exempt of challenges as a result of fast time-varying propagation and highly dynamic vehicular networks and topologies. To address some of these challenges, we propose an attention-deep reinforcement learning jointly beamforming based on tensor decomposition for RIS-assisted mmWave massive MIMO system to improving the safety and traffic efficiency of cooperative automated driving. The received signal of the vehicle is decomposed into four-dimensional tensors and study the channel, frequency and time attention (CFTA) algorithm using the low order tensor characteristics of mmWave channels. This algorithm can extract the frequency and time characteristics of the channel, and obtain the millimeter wave characteristic channel between the corresponding base station (BS) and the vehicles. The problem of jointly optimization of beamforming matrix at the BS and the phase shift matrix on the RIS is constructed and solved using deep reinforcement learning (DRL). Unlike traditional alternating optimization methods, the integration of DRL techniques into the optimal design of the system enables the observation of immediate rewards, learning from the environment and improving it to obtain optimal solutions to high-dimensional jointly beamforming optimization problems ultimately. The simulation results show that the proposed algorithm has meaningful performance compared with other methods.

Piecewise-DRL: Joint Beamforming Optimization for RIS-Assisted MU-MISO Communication System

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

Joint Beamforming in RIS-Assisted Multi-User Transmission Design: A Model-Driven Deep Reinforcement Learning Framework

A RIS-Assisted Multiuser MIMO Communication Method Based on Deep Reinforcement Learning

Low-Complexity Joint Beamforming for RIS-Assisted MU-MISO Systems Based on Model-Driven Deep Learning

Integrated Beamforming and Resource Allocation in RIS-Assisted Mmwave Networks Based on Deep Reinforcement Learning

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems

An Efficient Learning Algorithm for Phase Shift Optimization in RIS-Aided MISO Wireless Systems

An MRL-Based Design Solution for RIS-Assisted MU-MIMO Wireless System under Time-Varying Channels

Joint Beamforming Design and Blocklength Optimization for Low-Latency Multi-User MISO URLLC Systems

DRL-based Joint Beamforming and BS-RIS-UE Association Design for RIS-Assisted mmWave Networks

Hybrid Beamforming for RIS-Empowered Multi-hop Terahertz Communications: A DRL-based Method

Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided Mmwave MIMO Systems

Deep Reinforcement Learning based Downlink Beamforming and Phase Optimization for RIS-Aided Communication System

DRL-based Max-Min Fair RIS Discrete Phase Shift Optimization for MISO-OFDM Systems

Distributed DRL based Beamforming Design for RIS-Assisted Multi-cell Systems

A DRL-based Reflection Enhancement Method for RIS-assisted Multi-receiver Communications

Attention-deep reinforcement learning jointly beamforming based on tensor decomposition for RIS-assisted V2X mmWave massive MIMO system

DRL-Based Beamforming Design in RIS-Aided Multi-user Wireless Networks

Multi-User MISO with Stacked Intelligent Metasurfaces: A DRL-Based Sum-Rate Optimization Approach