Triple GNN: A Pedestrian-Scene-Object Joint Model for Pedestrian Trajectory Prediction

Xinshengzi Huang,Qiong Liu,You Yang
DOI: https://doi.org/10.1007/978-3-031-20497-5_6
2022-01-01
Abstract:Pedestrian trajectory prediction is an amazing but challenging task for vision guided applications, including autonomous driving, intelligent surveillance system, etc. Practically, the trajectory is a result of interaction among pedestrian's surrounding people, scenes and related objects, which can be represented by a triple. In previous works, limited interactions have been exploited, such as pedestrian-pedestrian and pedestrian-object. These works are facing challenges when comprehensive interactions in natural scenes are involved. In this paper, we propose a triple graph neural network (Triple GNN) where interactions among pedestrians, scenes and objects are all taken into the prediction of pedestrian trajectory. Based on that, spatial relation is exploited to describe the mutual interaction among triple elements, and a two-stage optimization scheme is proposed on weights of the interaction aggregation for better relation exploitation and prediction. Furthermore, temporal relation is also exploited for compact representation and effective computation of future trajectories based on the spatial relation. Our method is verified via ETH and UCY datasets and achieves the state-of-the-art performance.
What problem does this paper attempt to address?