Modeling Scene-Agent Interaction for Pedestrian Trajectory Prediction

Tianlu Mao,Pengfei Yao,Yinglong Zhu,Hao Jiang,Zhaoqi Wang
DOI: https://doi.org/10.1109/ICME57554.2024.10687499
2024-07-15
Abstract:Modeling scene-agent interaction is required in reliable and feasible for pedestrian trajectory prediction. Most existing methods utilize segmentation result of scene images as semantic information and concatenate it with trajectory features to model scene-agent interaction by concatenating semantic features with trajectory features. Since the image and trajectory are heterogeneous data, directly concatenating features proves inadequate for modeling scene-agent interaction. We notice that agent trajectory is the result of the interaction between the agent movement decision and the scene. They could be regarded as examples that demonstrate the influence between the scene and pedestrians’ motion in different locations. Compared with semantic image, historical trajectories of neighboring agents do not cover the whole scene, but they are more direct and efficient information for scene-agent interaction modeling. We propose a novel scene-agent interaction modeling method which uses Fourier Transform to convert the temporal historical trajectories into the frequency domain, utilizes transformer to encode the scene-agent interaction feature(SAIF), and designs a spectral position embedding to represents the scene influence on the agents. We combine the spatio-temporal features of trajectories and inter-agent interaction features with SAIF for generating predicted trajectories. Experiments demonstrate that our method achieves the state-of-the-art on both ETH-UCY and SDD.
Computer Science
What problem does this paper attempt to address?