Trajectory Prediction for Autonomous Driving Using a Transformer Network

Zhenning Li,Hao Yu
2024-02-26
Abstract:Predicting the trajectories of surrounding agents is still considered one of the most challenging tasks for autonomous driving. In this paper, we introduce a multi-modal trajectory prediction framework based on the transformer network. The semantic maps of each agent are used as inputs to convolutional networks to automatically derive relevant contextual information. A novel auxiliary loss that penalizes unfeasible off-road predictions is also proposed in this study. Experiments on the Lyft l5kit dataset show that the proposed model achieves state-of-the-art performance, substantially improving the accuracy and feasibility of the prediction outcomes.
Robotics
What problem does this paper attempt to address?
The paper proposes a multimodal trajectory prediction framework based on the Transformer network to address the challenge of predicting the trajectories of surrounding agents in autonomous driving. The model utilizes a semantic map of the scene as input to automatically extract relevant contextual information and introduces a new loss function penalizing infeasible non-road predictions to generate more realistic predicted trajectories. Experimental results demonstrate that the model achieves state-of-the-art performance on the Lyft l5kit dataset, improving prediction accuracy and feasibility.