MSTCNN: multi-modal spatio-temporal convolutional neural network for pedestrian trajectory prediction
Haifeng Sang,Wangxing Chen,Haifeng Wang,Jinyu Wang
DOI: https://doi.org/10.1007/s11042-023-15989-4
IF: 2.577
2023-06-19
Multimedia Tools and Applications
Abstract:Pedestrian trajectory prediction is of great significance in correctly planning a reasonable path. Most of the existing trajectory prediction methods take all the surrounding pedestrians at once into account, inevitably causing redundant information. Besides, they mainly do not make full use of the pedestrian movement trend information. Therefore, a pedestrian trajectory prediction model was proposed in this study based on multi-modal spatio-temporal interaction. The model assigned different weights to different pedestrians in different situations through the multi-modal pedestrian spatial interaction module, so that model could markedly reduce the influence of redundant information. The model trend capture module designed in this research could collect the pedestrian movement trend information, increasing the accuracy of the pedestrian trajectory prediction model. Finally, the temporal convolutional network module was utilized to predict the parameters of the two-dimensional Gaussian distribution of future pedestrian trajectories. Experimental results showed that compared with the latest pedestrian trajectory prediction model, the final displacement error was reduced by 3% in the ETH and UCY datasets. It is noteworthy that the proposed model only used convolutional neural networks, and the number of model parameters was noticeably lower than that of previous models.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering