Abstract:Abstract To achieve a green and sustainable wireless communication network, the reconfigurable intelligent surface (RIS) technology has emerged as an emerging technology. The RIS-assisted mmWave massive MIMO vehicle-to-everything (V2X) communications can support enhanced V2X applications for connected and automated vehicles. The design of RIS-assisted mmWave V2X communications is though not exempt of challenges as a result of fast time-varying propagation and highly dynamic vehicular networks and topologies. To address some of these challenges, we propose an attention-deep reinforcement learning jointly beamforming based on tensor decomposition for RIS-assisted mmWave massive MIMO system to improving the safety and traffic efficiency of cooperative automated driving. The received signal of the vehicle is decomposed into four-dimensional tensors and study the channel, frequency and time attention (CFTA) algorithm using the low order tensor characteristics of mmWave channels. This algorithm can extract the frequency and time characteristics of the channel, and obtain the millimeter wave characteristic channel between the corresponding base station (BS) and the vehicles. The problem of jointly optimization of beamforming matrix at the BS and the phase shift matrix on the RIS is constructed and solved using deep reinforcement learning (DRL). Unlike traditional alternating optimization methods, the integration of DRL techniques into the optimal design of the system enables the observation of immediate rewards, learning from the environment and improving it to obtain optimal solutions to high-dimensional jointly beamforming optimization problems ultimately. The simulation results show that the proposed algorithm has meaningful performance compared with other methods.

Physics-Assisted Deep Reinforcement Learning-Based TSV Array Design for Signal and Power Integrity Co-Optimization

A novel cross-layer framework for early-stage power delivery and architecture co-exploration.

Policy-Based Reinforcement Learning for Through Silicon Via Array Design in High-Bandwidth Memory Considering Signal Integrity

Deep Reinforcement Learning-Based Pin Map Optimization of BGA Package for EMC

A Novel Deep Reinforcement Learning Methodology for EMI Mitigation in Multi-Scenario Pinmap Design

Deep Reinforcement Learning-aided Transmission Design for Energy-efficient Link Optimization in Vehicular Communications

Pin Assignment Optimization of BGA Packages for EMI Mitigation Using Deep Reinforcement Learning

Different designs of TSVs for 3D IC: Signal integrity analysis with cascaded scattering matrix

Deep Learning for Secure Transmission in Reconfigurable Intelligent Surface-Assisted Communications.

Deep Reinforcement Learning-Based Ground-Via Placement Optimization for EMI Mitigation

Efficient EMI Analysis and Self-Shielding Design Method for Pin Map of System-in-Package

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

DRL-Based Orchestration of Multi-User MISO Systems with Stacked Intelligent Metasurfaces

Automated Design and Optimization of Distributed Filtering Circuits via Reinforcement Learning

Attention-deep reinforcement learning jointly beamforming based on tensor decomposition for RIS-assisted V2X mmWave massive MIMO system

A DRL Approach for RIS-Assisted Full-Duplex UL and DL Transmission: Beamforming, Phase Shift and Power Optimization

Automatic SPICE- Integrated Reinforcement Learning for Decap Optimization for EMI and Power Integrity

Hierarchical Decoupling Capacitor Optimization for Power Distribution Network of 2.5D ICs with Co-Analysis of Frequency and Time Domains Based on Deep Reinforcement Learning

Multi-User MISO with Stacked Intelligent Metasurfaces: A DRL-Based Sum-Rate Optimization Approach

Power Optimization in Device-to-Device Communications: A Deep Reinforcement Learning Approach with Dynamic Reward.