Forecasting Future Trajectories with an Improved Transformer Network

Wei Wu,Weigong Zhang,Dong Wang,Lydia Zhu,Xiang Song
DOI: https://doi.org/10.32604/cmc.2023.029787
2023-01-01
Abstract:An increase in car ownership brings convenience to people's life. However, it also leads to frequent traffic accidents. Precisely forecasting surrounding agents' future trajectories could effectively decrease vehicle-vehicle and vehicle-pedestrian collisions. Long-short-term memory (LSTM) network is often used for vehicle trajectory prediction, but it has some shortages such as gradient explosion and low efficiency. A trajectory prediction method based on an improved Transformer network is proposed to forecast agents' future trajectories in a complex traffic environment. It realizes the transformation from sequential step processing of LSTM to parallel processing of Transformer based on attentionmechanism. To performtrajectory predictionmore efficiently, a probabilistic sparse self-attention mechanism is introduced to reduce attention complexity by reducing the number of queried values in the attention mechanism. Activate or not (ACON) activation function is adopted to select whether to activate or not, hence improving model flexibility. The proposed method is evaluated on the publicly available benchmarks next-generation simulation (NGSIM) and ETH/UCY. The experimental results indicate that the proposed method can accurately and efficiently predict agents' trajectories.
What problem does this paper attempt to address?