Abstract:The development of Long Term Evolution (LTE) enables wireless communication with high transmission rate, low latency, and wide coverage area. These outstanding features of LTE support the next generation of vehicle-to-everything (V2X) communication, which is named LTE-V. Among the various technologies in LTE-V, placing relay nodes on vehicles is a promising approach to save power and energy, and extend the transmission range. In this paper, we consider the virtual relay node selection problem. In the problem, a base station transmits data to a vehicle relay (also known as helper) who will further disseminate the received data to the vehicular subscribers nearby. The selection of the vehicle relay node is a challenging issue since the utility of the selection can only be known after this action has been made. Another challenge of this problem is that the traditional pure optimization is inapplicable due to the imperfect information available. Motivated by the recent success of Alpha Go Zero, we employ deep reinforcement learning (DRL) as a powerful tool for facing the above challenges and solving the problem without global information. We build a bridge between the traffic information and decision of relay node selection based on the reality that the utility of vehicle relay is highly correlated with the traffic density. In our work, deep convolutional neural networks are first applied to extract traffic patterns and then learn the traffic and network topology. Deep learning (DL) acts as a role to map features inside traffic and communication topology to the decisions. Then Q-Learning dynamically updates the utilities of decisions by trials in the environment. Finally, the overall rewards can be calculated to measure these decisions, and the Q function is also updated. Simulation results based on real traffic data validate that our proposed approach can achieve high utility performance.

An Unsupervised-Learning-Based Method for Multi-Hop Wireless Broadcast Relay Selection in Urban Vehicular Networks.

A distributed relay selection using a fuzzy-BCM based decision making strategy for multi-hop data dissemination in VANETs

A Probabilistic Broadcasting Scheme for Emergent Message Dissemination in Urban Internet of Vehicles

A Multi-Hop Broadcast Protocol for Emergency Message Dissemination in Urban Vehicular Ad Hoc Networks.

Joint Optimization of Relay Selection and Transmission Scheduling for UAV-Aided mmWave Vehicular Networks

Priority Levels Based Multi-hop Broadcasting Method for Vehicular Ad hoc Networks

Joint Optimization of Relay Selection and Transmission Scheduling for UAV-Aided mm Wave Vehicular Networks

Multiple intersection selection routing protocol based on road section connectivity probability for urban VANETs

Relay in the Sky: A UAV-Aided Cooperative Data Dissemination Scheduling Strategy in VANETs

A distributed relay selection method for relay assisted Device-to-Device communication system

Cooperative Localisation for Multi-Rsu Vehicular Networks Based on Predictive Beamforming

ARSL-V: A risk-aware relay selection scheme using reinforcement learning in VANETs

Urban Data Acquisition Routing Approach for Vehicular Sensor Networks

Application-based Performance Evaluation of Wireless Access in Vehicular Environment Using Broadcast Protocol

Distributed Relay Selection for Heterogeneous UAV Communication Networks Using A Many-to-Many Matching Game Without Substitutability

Enhanced Multi-Hop Mechanism in Vehicular Communication System Using Swarm Algorithm.

Virtual Relay Selection in LTE-V: A Deep Reinforcement Learning Approach to Heterogeneous Data

Selection of relays based on the classification of mobility‐type and localized network metrics in the Internet of Vehicles

Efficient route guidance in vehicular wireless networks

Multi-Agent Learning Based Packet Routing in Multi-Hop UAV Relay Network

Relay schemes for intermittently connected vehicular networks with heterogeneous nodes