A Multi-Layer Model Based on Transformer and Deep Learning for Traffic Flow Prediction
He-Xuan Hu,Qiang Hu,Guoping Tan,Ye Zhang,Zhen-Zhou Lin
DOI: https://doi.org/10.1109/tits.2023.3311397
IF: 8.5
2023-01-01
IEEE Transactions on Intelligent Transportation Systems
Abstract:Using traffic data to accurately predict the traffic flow at a certain time in the future can alleviate problems such as traffic congestion, which plays an important role in the healthy transportation and economic development of cities. However, current traffic flow prediction models rely on human experience and only consider the advantages of single machine learning model. Therefore, in this work, we propose a multi-layer model based on transformer and deep learning for traffic flow prediction (MTDLTFP). The MTDLTFP model first draws on the idea of transformer model, which uses multiple encoders and decoders to perform feature extraction on the initial traffic data without human experience. In addition, in the prediction stage, the MTDLTFP model using deep learning technology, which input the hidden features into the convolutional neural network (CNN) and multi-layer feedforward neural network (MFNN) to obtain the prediction score respectively. The CNN model can captures the correlation information between the hidden features, and the MFNN can captures the nonlinear relationship between the features. Finally, we use a linear model to combine the two prediction scores, which can make the final prediction value take into account the common advantages of both models. Multiple experimental results on two real datasets demonstrate the effectiveness of the MTDLTFP model. The experimental results on the $WorkDay$ dataset are as follows, with the RMSE value of 0.191, MAE value of 0.165. The experimental results on the $HoliDay$ dataset are as follows, with RMSE value of 0.227, MAE value of 0.192.
engineering, electrical & electronic,transportation science & technology, civil