Abstract:In recent years, a new wireless network called vehicular ad-hoc network (VANET), has become a popular research topic. VANET allows communication among vehicles and with roadside units by providing information to each other, such as vehicle velocity, location and direction. In general, when many vehicles likely to use the common route to proceed to the same destination, it can lead to a congested route that should be avoided. It may be better if vehicles are able to predict accurately the traffic congestion and then avoid it. Therefore, in this work, the deep reinforcement learning in VANET to enhance the ability to predict traffic congestion on the roads is proposed. Furthermore, different types of neural networks namely Convolutional Neural Network (CNN), Multilayer Perceptron (MLP) and Long Short-Term Memory (LSTM) are investigated and compared in this deep reinforcement learning model to discover the most effective one. Our proposed method is tested by simulation. The traffic scenarios are created using traffic simulator called Simulation of Urban Mobility (SUMO) before integrating with deep reinforcement learning model. The simulation procedures, as well as the programming used, are described in detail. The performance of our proposed method is evaluated using two metrics; the average travelling time delay and average waiting time delay of vehicles. According to the simulation results, the average travelling time delay and average waiting time delay are gradually improved over the multiple runs, since our proposed method receives feedback from the environment. In addition, the results without and with three different deep learning algorithms, i.e., CNN, MLP and LSTM are compared. It is obvious that the deep reinforcement learning model works effectively when traffic density is neither too high nor too low. In addition, it can be concluded that the effective algorithms for traffic congestion prediction models in descending order are MLP, CNN, and LSTM, respectively.

Network Traffic Prediction Model Considering Road Traffic Parameters Using Artificial Intelligence Methods in VANET

Network Traffic Prediction for Intelligent Transportation Systems: A Reinforcement Learning Approach

TrafficPro: A Road Speed Prediction Framework for Urban Signal-Controlled Road Networks

Digital Twin for Transportation Big Data: A Reinforcement Learning-Based Network Traffic Prediction Approach

Traffic Congestion Prediction using Deep Reinforcement Learning in Vehicular Ad-Hoc Networks (VANETS)

Deep Learning-Based Network Traffic Prediction for Secure Backbone Networks in Internet of Vehicles

Research on Traffic Accident Prediction Model Based on Convolutional Neural Networks in VANET

A performance modeling and analysis of a novel vehicular traffic flow prediction system using a hybrid machine learning-based model

Self-Organizing Traffic Flow Prediction with an Optimized Deep Belief Network for Internet of Vehicles

Application of a Traffic Flow Prediction Model Based on Neural Network in Intelligent Vehicle Management

Intelligent Traffic Flow Prediction Using Optimized GRU Model

Prediction of Road Traffic using a Neural Network Approach

Prediction and Analysis of Machine Learning Models for Efficient Routing Protocol in VANET Using Feature Information

An Intelligent Congestion Avoidance Mechanism Based on Generalized Regression Neural Network for Heterogeneous Vehicular Networks

Neural Network Based Traffic Prediction for Wireless Data Networks

Towards the Design of Smart Vehicular Traffic Flow Prediction

From statistical‐ to machine learning‐based network traffic prediction

Accident Prediction System Based on Hidden Markov Model for Vehicular Ad-Hoc Network in Urban Environments

Variational Graph Neural Networks for Road Traffic Prediction in Intelligent Transportation Systems

Prediction of Road Network Traffic State Using the NARX Neural Network

Network Traffic Prediction Using Variational Mode Decomposition and Multi- Reservoirs Echo State Network