Abstract:Accurate traffic congestion estimation and prediction are critical building blocks for smart trip planning and rerouting decisions in transportation systems. Over the decades, there have been many studies focusing on traffic congestion estimation and prediction with different statistical approaches (e.g., Markov chain) and machine learning models (e.g., clustering, Bayesian networks, and artificial neural networks). However, there is a lack of a unified framework to address the mechanisms of different models and integrate the advantages of different methods through combinations. This paper introduces the FD-Markov-LSTM model, a hybrid interpretable approach that combines the fundamental diagram (FD), Markov chain, and long short-term memory (LSTM). The aim is to estimate and predict traffic states by integrating statistical data in both congested and uncongested scenarios. The FD-Markov-LSTM model leverages the FD to identify hierarchical traffic states and utilizes the Markov process to capture the probabilistic transitions between these states. We employ the LSTM model to further capture the residual time series produced by the Markov chain model (assuming a memoryless property) to enhance the estimation and prediction performance. The proposed model's accuracy in estimating and predicting traffic flow is evaluated using empirical data from three case studies conducted in Beijing and Los Angeles. The results highlight a significant improvement in accuracy compared to classical benchmark models such as the Markov model, ARIMA model, k-Nearest Neighbor model, Random Forest model, and LSTM. Specifically, the FD-Markov-LSTM model achieves reductions of over 39% in mean absolute error, 35% in root mean squared error, and 7.4% in mean absolute percentage error. These results clearly demonstrate that the FD-Markov-LSTM model outperforms the benchmark models, enabling more precise predictions of traffic flow.

A Survey of Hybrid Deep Learning Methods for Traffic Flow Prediction

A Survey of Traffic Flow Prediction Methods Based on Long Short-Term Memory Networks

A Hybrid Deep Learning Based Traffic Flow Prediction Method and Its Understanding

Short-Term Forecasting of Traffic Flow and Speed: A Deep Learning Approach

A Hybrid Deep Learning Model for Short-Term Traffic Flow Pre-Diction Considering Spatiotemporal Features

Hybrid deep learning models for traffic prediction in large-scale road networks

Fuzzy Hybrid Framework with Dynamic Weights for Short‐term Traffic Flow Prediction by Mining Spatio‐temporal Correlations

A Hybrid Method for Traffic Flow Forecasting Using Multimodal Deep Learning

A Hybrid Deep Learning Model With Attention-Based Conv-LSTM Networks for Short-Term Traffic Flow Prediction

A Novel Hybrid Model for Short-Term Traffic Flow Prediction Based on Spatio-Temporal Deep Learning With Considering Associated Factors Selection

Daily Long-Term Traffic Flow Forecasting Based on a Deep Neural Network

Traffic Flow Prediction Based on Deep Neural Networks

A Comparison of Traffic Flow Prediction Methods Based on DBN

Short-Term Traffic Flow Prediction: An Integrated Method of Econometrics and Hybrid Deep Learning

Short-Term Traffic Flow Prediction for Hybrid Time Series Decomposition Analysis and LSTM Neural Network

Leveraging Spatio-Temporal Patterns for Predicting Citywide Traffic Crowd Flows Using Deep Hybrid Neural Networks

A Survey on Modern Deep Neural Network for Traffic Prediction: Trends, Methods and Challenges

A Fundamental Diagram Based Hybrid Framework for Traffic Flow Estimation and Prediction by Combining a Markovian Model with Deep Learning

Traffic Flow Prediction With Big Data: A Deep Learning Approach