Abstract:In recent years, a new wireless network called vehicular ad-hoc network (VANET), has become a popular research topic. VANET allows communication among vehicles and with roadside units by providing information to each other, such as vehicle velocity, location and direction. In general, when many vehicles likely to use the common route to proceed to the same destination, it can lead to a congested route that should be avoided. It may be better if vehicles are able to predict accurately the traffic congestion and then avoid it. Therefore, in this work, the deep reinforcement learning in VANET to enhance the ability to predict traffic congestion on the roads is proposed. Furthermore, different types of neural networks namely Convolutional Neural Network (CNN), Multilayer Perceptron (MLP) and Long Short-Term Memory (LSTM) are investigated and compared in this deep reinforcement learning model to discover the most effective one. Our proposed method is tested by simulation. The traffic scenarios are created using traffic simulator called Simulation of Urban Mobility (SUMO) before integrating with deep reinforcement learning model. The simulation procedures, as well as the programming used, are described in detail. The performance of our proposed method is evaluated using two metrics; the average travelling time delay and average waiting time delay of vehicles. According to the simulation results, the average travelling time delay and average waiting time delay are gradually improved over the multiple runs, since our proposed method receives feedback from the environment. In addition, the results without and with three different deep learning algorithms, i.e., CNN, MLP and LSTM are compared. It is obvious that the deep reinforcement learning model works effectively when traffic density is neither too high nor too low. In addition, it can be concluded that the effective algorithms for traffic congestion prediction models in descending order are MLP, CNN, and LSTM, respectively.

Virtual Traffic Simulation with Neural Network Learned Mobility Model.

A cooperative mobility model for multiple autonomous vehicles

Modeling Real-Time Human Mobility Based on Mobile Phone and Transportation Data Fusion

Data-driven Vehicular Mobility Modeling and Prediction

Adaptive-AR Model with Drivers' Prediction for Traffic Simulation

Markov Chain Mobility Model for Multi-lane Highways

Integrated Traffic Simulation-Prediction System using Neural Networks with Application to the Los Angeles International Airport Road Network

Virtual Reality Mobility Model for Wireless Ad Hoc Networks

On the Movement Simulations of Electric Vehicles: A Behavioral Model-Based Approach

Discovering the optimal relationship hypothesis of car-following behaviors with neural network-based symbolic regression

Learning Mobility Flows from Urban Features with Spatial Interaction Models and Neural Networks

[May cell transplantation repair infarcted myocardium?].

Modelling motorized and non-motorized vehicle conflicts using multiagent inverse reinforcement learning approach

Dynamic Traffic Congestion Simulation and Dissipation Control Based on Traffic Flow Theory Model and Neural Network Data Calibration Algorithm

A Markov Jump Process Model for Urban Vehicular Mobility: Modeling and Applications.

Utilizing Hybrid Trajectory Prediction Models to Recognize Highly Interactive Traffic Scenarios

Cell-based Simulation and Estimation of Urban Traffic Network

A Calibrated Force-Based Model for Mixed Traffic Simulation.

Traffic Modeling Based on Data-Driven Method for Simulation Test of Autonomous Driving

Mobility Models for Vehicular Ad-hoc Network Simulation

Traffic Congestion Prediction using Deep Reinforcement Learning in Vehicular Ad-Hoc Networks (VANETS)