Deep Learning Method Based on Multiscale Enhanced Feature Fusion for Vehicle Behavior Prediction

Xingyu Wang,Qirui Luo,Kai Liu,Ruichi Mao,Guangqiang Wu
DOI: https://doi.org/10.1109/jiot.2024.3508034
IF: 10.6
2024-01-01
IEEE Internet of Things Journal
Abstract:Vehicle behavior prediction is a crucial area of research aimed at enhancing the safety of intelligent connected vehicles in complex traffic scenarios. However, many existing methods rely on one-dimensional driving data or lack the fusion processing of multiscale input features, leading to reduced model prediction accuracy and unnecessary computational load. In this study, we introduce a deep neural network for multiscale enhanced feature fusion. Initially, we utilize Gramian Angular Field (GAF) and Exponential Short-Time Fourier Transform (ESTFT) to transform one-dimensional data into a graph containing time-frequency information, thereby improving the interpretability of input features. Subsequently, we develop a multiscale cross-learning attention (MCA) mechanism to facilitate cross-domain and cross-scale feature interactions within the two-dimensional graph, along with a multiscale global attention (MGA) mechanism to enhance feature learning by considering the spatial relationships of one-dimensional data. Finally, we utilize multi head attention mechanism to allocate adaptive weights to multiscale enhanced feature information, and incorporate Bi-directional long short-term memory (Bi-LSTM) to model time dependencies and generate prediction results. Our proposed approach demonstrates improved performance in vehicle behavior prediction compared to existing methods, as validated on both HighD and NGSIM datasets.
What problem does this paper attempt to address?