Abstract:Accurate and reliable trajectory prediction is crucial for autonomous vehicles to achieve safe and efficient operation. Vehicles perceive the historical trajectories of moving objects and make predictions of behavioral intentions for a future period of time. With the predicted trajectories of moving objects such as obstacle vehicles, pedestrians, and non-motorized vehicles as inputs, self-driving vehicles can make more rational driving decisions and plan more reasonable and safe vehicle motion behaviors. However, due to traffic environments such as intersection scenes with highly interdependent and dynamic attributes, the task of motion anticipation becomes challenging. Existing works focus on the mutual relationships among vehicles while ignoring other potential essential interactions such as vehicle–traffic rules. These studies have not yet deeply explored the intensive learning of interactions between multi-agents, which may result in evaluation deviations. Aiming to meet these issues, we have designed a novel framework, namely trajectory prediction with attention-based spatial–temporal graph convolutional networks (TPASTGCN). In our proposal, the multi-agent interaction mechanisms, including vehicle–vehicle and vehicle–traffic rules, are meticulously highlighted and integrated into one homogeneous graph by transferring the time-series data of traffic lights into the spatial–temporal domains. Through integrating the attention mechanism into the adjacency matrix, we effectively learn the different strengths of interactive association and improve the model’s ability to capture critical features. Simultaneously, we construct a hierarchical structure employing the spatial GCN and temporal GCN to extract the spatial dependencies of traffic networks. Profiting from the gated recurrent unit (GRU), the scene context in temporal dimensions is further attained and enhanced with the encoder. In such a way, the GCN and GRU networks are fused as a features extractor module in the proposed framework. Finally, the future potential trajectories generation tasks are performed by another GRU network. Experiments on real-world datasets demonstrate the superior performance of the scheme compared with several baselines.

Co-attention Trajectory Prediction by Mining Heterogeneous Interactive Relationships

Multi-Agent Trajectory Prediction With Heterogeneous Edge-Enhanced Graph Attention Network

HSTA: A Hierarchical Spatio-Temporal Attention Model for Trajectory Prediction

Pedestrian trajectory prediction based on spatio-temporal attention mechanism

Complementary Attention Gated Network for Pedestrian Trajectory Prediction

Hierarchical Multi-Supervision Multi-Interaction Graph Attention Network for Multi-Camera Pedestrian Trajectory Prediction

Exploring Complex Dependencies for Multi-modal Semantic Trajectory Prediction

A Spatial-Temporal Attentive Network with Spatial Continuity for Trajectory Prediction

Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Network

Spatio-Temporal Interaction Aware and Trajectory Distribution Aware Graph Convolution Network for Pedestrian Multimodal Trajectory Prediction

Hierarchical Attention Network for Planning-informed Multi-Agent Trajectory Prediction

Multi-Relational Pedestrian Trajectory Prediction in Complex Scenes.

Spatio-Temporal-Interaction Graph Neural Networks for Multi-Agent Trajectory Prediction

Traffic Agents Trajectory Prediction Based on Spatial-Temporal Interaction Attention

Holistic Spatio-Temporal Graph Attention for Trajectory Prediction in Vehicle-Pedestrian Interactions

Multi-Interaction Trajectory Prediction Method With Serial Attention Patterns for Intelligent Vehicles

Situation-Aware Pedestrian Trajectory Prediction with Spatio-Temporal Attention Model

Heterogeneous Interaction Modeling With Reduced Accumulated Error for Multiagent Trajectory Prediction

Simultaneous Past and Current Social Interaction-aware Trajectory Prediction for Multiple Intelligent Agents in Dynamic Scenes

Heterogeneous Interaction Modeling With Reduced Accumulated Error for Multi-Agent Trajectory Prediction

Trajectory Prediction with Attention-Based Spatial–Temporal Graph Convolutional Networks for Autonomous Driving