Intention-aware Long Horizon Trajectory Prediction of Surrounding Vehicles using Dual LSTM Networks

Long Xin,Pin Wang,Ching-Yao Chan,Jianyu Chen,Shengbo Eben Li,Bo Cheng
DOI: https://doi.org/10.48550/arXiv.1906.02815
2019-06-07
Abstract:As autonomous vehicles (AVs) need to interact with other road users, it is of importance to comprehensively understand the dynamic traffic environment, especially the future possible trajectories of surrounding vehicles. This paper presents an algorithm for long-horizon trajectory prediction of surrounding vehicles using a dual long short term memory (LSTM) network, which is capable of effectively improving prediction accuracy in strongly interactive driving environments. In contrast to traditional approaches which require trajectory matching and manual feature selection, this method can automatically learn high-level spatial-temporal features of driver behaviors from naturalistic driving data through sequence learning. By employing two blocks of LSTMs, the proposed method feeds the sequential trajectory to the first LSTM for driver intention recognition as an intermediate indicator, which is immediately followed by a second LSTM for future trajectory prediction. Test results from real-world highway driving data show that the proposed method can, in comparison to state-of-art methods, output more accurate and reasonable estimate of different future trajectories over 5s time horizon with root mean square error (RMSE) for longitudinal and lateral prediction less than 5.77m and 0.49m, respectively.
Machine Learning,Robotics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: **How to accurately predict the future trajectories of surrounding vehicles in a dynamic traffic environment, especially for long - time - range predictions (such as 5 seconds)**. This problem is crucial for the safety and efficient operation of autonomous vehicles (AVs). ### Problem Background: 1. **Complex Interactivity**: Autonomous vehicles need to interact with other road users, so they must be able to understand the dynamic traffic environment, especially the possible future trajectories of surrounding vehicles. 2. **Limitations of Existing Methods**: - Traditional methods rely on trajectory matching and manual feature selection, and it is difficult to handle complex driving behaviors. - The prediction accuracy of existing methods in the long - time range is insufficient, especially in strongly interactive driving environments. - Some methods rely on limited prototype trajectories or occupancy grid representations and cannot adapt to different road geometries. ### Solutions Proposed in the Paper: The paper proposes a method based on Dual Long - Short - Term Memory Networks (Dual LSTM Networks) for predicting the long - time trajectories of surrounding vehicles. The main features of this method are as follows: - **Intention Awareness**: Identify the driver's intention (such as keeping in the lane, changing lanes, etc.) through the first LSTM network as an intermediate indicator. - **Sequence Learning**: The second LSTM network further predicts the future trajectory based on the intention recognition result. - **Automatically Learn Spatio - Temporal Features**: This method can automatically learn the high - level spatio - temporal features of driver behavior from natural driving data without the need for manual feature selection. - **High - Precision Prediction**: The experimental results show that within a time range of 5 seconds, the root - mean - square errors (RMSE) of longitudinal and lateral predictions of this method are less than 5.77 meters and 0.49 meters respectively, which is better than the existing advanced methods. ### Formula Representation: 1. **Relative Lateral Position**: \[ x_{\text{rel}} = x - x_{\text{lane}} \] where \(x\) is the local lateral position and \(x_{\text{lane}}\) is the local lateral position of the nearest lane marker. 2. **Lateral Deviation from the Center Line**: \[ x_{\text{dev}} = x - x_{\text{center}} \] where \(x_{\text{center}}\) is the local lateral position of the center line of the target lane. 3. **LSTM Cell Update Formula**: \[ i_t=\sigma(W_{xi}x_t + W_{hi}h_{t - 1}+b_i) \] \[ f_t=\sigma(W_{xf}x_t + W_{hf}h_{t - 1}+b_f) \] \[ o_t=\sigma(W_{xo}x_t + W_{ho}h_{t - 1}+b_o) \] \[ g_t = \tanh(W_{xc}x_t + W_{hc}h_{t - 1}+b_c) \] \[ c_t=f_t\odot c_{t - 1}+i_t\odot g_t \] \[ h_t=o_t\odot \tanh(c_t) \] 4. **Future Trajectory Calculation**: \[ v(t)=v(t - 1)+a(t)\cdot\Delta t \] \[ y(t)=y(t - 1)+v(t)\cdot\Delta t \] \[ x(t)=x_{\text{dev}}(t)+x_{\text{center}} \] Through these methods and formulas, the paper aims to improve the prediction accuracy of autonomous vehicles for the future trajectories of surrounding vehicles, thereby enhancing their decision - making and path - planning capabilities.