Abstract:Millimeter wave (mmWave) with abundant spectrum resources can realize high-rate communications in vehicular networks. However, the mobility of vehicles and the blocking effect of mmWave propagation bring new challenges to communication security. Cooperative communication is envisioned as a promising physical layer security (PLS) approach to enhance the secrecy performance, but it will induce extra energy consumption of vehicles. This paper proposes a deep recurrent reinforcement learning (DRRL)-based energy-efficient cooperative secure transmission scheme in mmWave vehicular networks, where eavesdropping vehicles attempt to intercept the multi-user downlink communications. We jointly design the mmWave beam allocation, the cooperative nodes selection, and the transmit power of vehicles. Specifically, the mmWave base station selects idle vehicles as relays to overcome the severe blocking attenuation of legitimate transmissions and controls the transmit power to reduce energy consumption. Moreover, to ensure secure transmission, a cooperative vehicle is selected to transmit jamming signals to the eavesdropping vehicles while the legitimate users are not disturbed. We conduct comprehensive interference analysis for both direct transmission and relay-aided transmission, and derive the theoretical expressions for the secrecy capacity. We then design the Dueling Double Deep Recurrent Q-Network (D3RQN) learning algorithm to maximize the total secrecy capacity subject to the energy consumption constraint. We set the energy consumption punishment mechanism to avoid relay vehicles consuming too much power for forwarding signals. We demonstrate that the proposed scheme can rapidly adapt to the highly dynamic vehicular networks and effectively improve secrecy performance while reducing the energy consumption of vehicles.

Learning-assisted User Scheduling and Beamforming for mmWave Vehicular Networks

DRL-based Beam Allocation in Relay-aided Multi-user MmWave Vehicular Networks

Multi-Agent Reinforcement Learning-Based Cooperative Beam Selection in Mmwave Vehicular Networks

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Dual-layer Deep Reinforcement Learning for Joint Beam Management and Resource Allocation

Deep Reinforcement Learning Based MmWave Beam Alignment for V2I Communications

User Schedule and Single-User RIS Allocation in QoS-Aware MmWave Vehicular Networks

Energy-Efficient Cooperative Secure Communications in Mmwave Vehicular Networks Using Deep Recurrent Reinforcement Learning

Network Capacity Optimization for Cellular-Assisted Vehicular Systems by Online Learning-Based Mmwave Beam Selection.

Beamforming Design in Vehicular Communication Systems With Multiple Reconfigurable Intelligent Surfaces: A Deep Learning Approach

Beam management optimization for V2V communications based on deep reinforcement learning

Attention-deep reinforcement learning jointly beamforming based on tensor decomposition for RIS-assisted V2X mmWave massive MIMO system

Joint Relay Selection and Beam Management Based on Deep Reinforcement Learning for Millimeter Wave Vehicular Communication

Joint User Scheduling and Beam Selection in Mmwave Networks Based on Multi-Agent Reinforcement Learning

Intelligent Reflecting Surface-Aided Centralized Scheduling for Mmwave V2V Networks

Multi-Agent Deep Reinforcement Learning for Cooperative Connected Vehicles

Joint Scheduling and Beamforming Design in Traffic-Aware RIS Aided MEC Network

Deep Reinforcement Learning Based Wireless Resource Allocation for V2X Communications

Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios

Intelligent Beam Management Based on Deep Reinforcement Learning in High-Speed Railway Scenarios

Smart Vehicular Communication Via 5G Mmwaves