An End-to-End Autonomous Driving Pre-trained Transformer Model for Multi-Behavior-Optimal Trajectory Generation

Zelin Qian,Kun Jiang,Weitao Zhou,Junze Wen,Cheng Jing,Zhong Cao,Diange Yang
DOI: https://doi.org/10.1109/itsc57777.2023.10421847
2023-01-01
Abstract:Advanced end-to-end (E2E) autonomous driving planning methods, e.g., reinforcement learning and imitation learning, employ neural networks to generate driving trajectories. However, most of them suffer from low data efficiency, i.e, they usually require a large amount of data to obtain even a simple behavior like car-following which a rule-based method can easily achieve. To this end, this work tackles the problem by introducing a pre-training method for E2E planning, which can generate multiple initial near-optimal trajectories for further fine-tuning with specific datasets. The challenges lie in that 1) various driving behaviors may be involved in a single case, leading to different optimal trajectories; 2) abstract driving behaviors are hard to be manually defined. Our idea is to first design a multi-head transformer network structure to capture the optimal trajectories for different driving behaviors. The training trajectory dataset is formed by an offline trajectory optimizer with different convex corridors which grow from sampled trajectories and imply various driving behaviors. In this way, the model can be pre-trained with various behavior-optimal trajectories, which can cover the whole driving space without manually defined behaviors. The results show that the pre-trained model can generate multiple trajectories for different behaviors without collected human demonstrations. This work can accelerate the future E2E model fine-tuning, with an acceptable initial baseline performance.
What problem does this paper attempt to address?