Abstract:With the rapid development of the intelligent transportation system (ITS), routing in vehicular ad hoc networks (VANETs) has become a popular research topic. The high mobility of vehicles in urban streets poses serious challenges to routing protocols and has a significant impact on network performance. Existing topology-based routing is not suitable for highly dynamic VANETs, thereby making location-based routing protocols the preferred choice due to their scalability. However, the working environment of VANETs is complex and interference-prone. In wireless-network communication, the channel contention introduced by the high density of vehicles, coupled with urban structures, significantly increases the difficulty of designing high-quality communication protocols. In this context, compared to topology-based routing protocols, location-based geographic routing is widely employed in VANETs due to its avoidance of the route construction and maintenance phases. Considering the characteristics of VANETs, this paper proposes a novel environment-aware adaptive reinforcement routing (EARR) protocol aimed at establishing reliable connections between source and destination nodes. The protocol adopts periodic beacons to perceive and explore the surrounding environment, thereby constructing a local topology. By applying reinforcement learning to the vehicle network's route selection, it adaptively adjusts the Q table through the perception of multiple metrics from beacons, including vehicle speed, available bandwidth, signal-reception strength, etc., thereby assisting the selection of relay vehicles and alleviating the challenges posed by the high dynamics, shadow fading, and limited bandwidth in VANETs. The combination of reinforcement learning and beacons accelerates the establishment of end-to-end routes, thereby guiding each vehicle to choose the optimal next hop and forming suboptimal routes throughout the entire communication process. The adaptive adjustment feature of the protocol enables it to address sudden link interruptions, thereby enhancing communication reliability. In experiments, the EARR protocol demonstrates significant improvements across various performance metrics compared to existing routing protocols. Throughout the simulation process, the EARR protocol maintains a consistently high packet-delivery rate and throughput compared to other protocols, as well as demonstrates stable performance across various scenarios. Finally, the proposed protocol demonstrates relatively consistent standardized latency and low overhead in all experiments.

RHRA-DRL: RSU-Assisted Hybrid Road-Aware Routing Using Distributed Reinforcement Learning in Internet of Vehicles

Hierarchical Reinforcement Learning-Based Routing Algorithm With Grouped RSU in Urban VANETs

Self-Organized Routing for Autonomous Vehicles Via Deep Reinforcement Learning

An Integrated DQN and RF Packet Routing Framework for the V2X Network

An Intersection-Based QoS Routing for Vehicular Ad Hoc Networks With Reinforcement Learning

Deep Reinforcement Learning-Based Intelligent Security Forwarding Strategy for VANET

An Intersection-Based Traffic Awareness Routing Protocol in VANETs Using Deep Reinforcement Learning

Environment-Aware Adaptive Reinforcement Learning-Based Routing for Vehicular Ad Hoc Networks

Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks

RC-LAHR: Road-Side-Unit-Assisted Cloud-Based Location-Aware Hybrid Routing for Software-Defined Vehicular Ad Hoc Networks

Transfer Learning-Based Deep Reinforcement Learning Approach for Robust Route Guidance in Mixed Traffic Environment

A Reinforcement Learning Framework for Vehicular Network Routing Under Peak and Average Constraints

Roadside Units Assisted Localized Automated Vehicle Maneuvering: An Offline Reinforcement Learning Approach

Intelligent Routing Algorithm over SDN: Reusable Reinforcement Learning Approach

DRL-Based RAT Selection in a Hybrid Vehicular Communication Network

Distributed Learning for Vehicle Routing Decision in Software Defined Internet of Vehicles

Augmented Mixed Vehicular Platoon Control with Dense Communication Reinforcement Learning for Traffic Oscillation Alleviation

RLSS: A Reinforcement Learning Scheme for HD Map Data Source Selection in Vehicular NDN

Distributed Adaptive Reinforcement Learning: A Method for Optimal Routing

An improved deep reinforcement learning routing technique for collision-free VANET

RSU-Assisted Adaptive Scheduling for Vehicle-to-Vehicle Data Sharing in Bidirectional Road Scenarios