Abstract:Recent research on pedestrian trajectory prediction based on deep learning has made significant progress. However, the previous methods do not deeply explore the relationship between scene information and trajectory. Moreover, the training model requires massive data and only targets specific scenes, so the prediction performance is poor when the new scene samples are limited. To solve the above problems, a meta-inverse reinforcement learning-based framework, dubbed Meta-IRLSOT++, is proposed in this work. IRLSOT++ improves the solid baseline IRLSOT, and the main contributions are as follows: (1) An inverse reinforcement learning framework is introduced to explore the trajectory–scene association to achieve task-level scene understanding, enhancing the correlation between trajectory and scene. The trajectory heat maps describing pedestrians dynamic characteristics are leveraged to align better the trajectory and scene semantic segmentation predicted by TopFormer. (2) A Transformer-based encoder–decoder network is proposed to fuse the trajectory and plan cues for better generating multi-modal trajectories with multi-head attention. The social graph attention and pseudo-oracle predictor are introduced to capture pedestrians’ social interactions and intent states, ameliorating trajectory prediction performance. (3) Meta-learning is leveraged to achieve collaborative training based on IRLSOT++ to improve the model generalization in new scenes, enabling fast adaptation of trajectory prediction. Experimental results on the Stanford Drone Dataset (SDD) indicate that IRLSOT++ can precisely forecast future trajectories by improving IRLSOT, decreasing Average Displacement Error/ Final Displacement Error (ADE/FDE) values from 9.66/13.05 to 8.36/12.28. Moreover, the meta-learning strategy quickly adapts IRLSOT++ to the new scene, achieving ADE/FDE values of 7.31/11.02 and 15.42/26.55 when T p r e d is set to 12 and 24, respectively. Both quantitative and qualitative experimental results show that Meta-IRLSOT++ has accuracy and fast adaptability, which is beneficial for real-world trajectory prediction tasks.

Region Profile Enhanced Urban Spatio-Temporal Prediction Via Adaptive Meta-Learning

MetaPTP: An Adaptive Meta-optimized Model for Personalized Spatial Trajectory Prediction

Urban Traffic Prediction from Spatio-Temporal Data Using Deep Meta Learning

Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Prediction

Meta-STMF: Meta-Learning Based Spatial Temporal Prediction Model Fusion Approach

Service Time Prediction for Delivery Tasks Via Spatial Meta-Learning

Exploring the Generalizability of Spatio-Temporal Traffic Prediction: Meta-Modeling and an Analytic Framework

Multiview Spatial-Temporal Meta-Learning for Multivariate Time Series Forecasting

STG-Meta: Spatial-Temporal Graph Meta-Learning for Traffic Forecasting.

Robust Spatio-Temporal Purchase Prediction Via Deep Meta Learning

STDA-Meta: A Meta-Learning Framework for Few-Shot Traffic Prediction

Meta-Learned User Preference For Topic Participation Prediction

Air Quality Prediction Model Based on Spatiotemporal Data Analysis and Metalearning

AutoSTL: Automated Spatio-Temporal Multi-Task Learning.

Meta-Learning-Based Spatial-Temporal Adaption for Coldstart Air Pollution Prediction

Dynamic meta-graph convolutional recurrent network for heterogeneous spatiotemporal graph forecasting

UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction

Meta-Transfer Learning Empowered Temporal Graph Networks for Cross-City Real Estate Appraisal

Meta-IRLSOT++: A meta-inverse reinforcement learning method for fast adaptation of trajectory prediction networks

Cross-City Transfer Learning for Deep Spatio-Temporal Prediction

CMS-LSTM: Context Embedding and Multi-Scale Spatiotemporal Expression LSTM for Predictive Learning