Abstract:Simultaneous trajectory prediction for multiple heterogeneous traffic participants is essential for safe and efficient operation of connected automated vehicles under complex driving situations. Two main challenges for this task are to handle the varying number of heterogeneous target agents and jointly consider multiple factors that would affect their future motions. This is because different kinds of agents have different motion patterns, and their behaviors are jointly affected by their individual dynamics, their interactions with surrounding agents, as well as the traffic infrastructures. A trajectory prediction method handling these challenges will benefit the downstream decision-making and planning modules of autonomous vehicles. To meet these challenges, we propose a three-channel framework together with a novel Heterogeneous Edge-enhanced graph ATtention network (HEAT). Our framework is able to deal with the heterogeneity of the target agents and traffic participants involved. Specifically, agents’ dynamics are extracted from their historical states using type-specific encoders. The inter-agent interactions are represented with a directed edge-featured heterogeneous graph and processed by the designed HEAT network to extract interaction features. Besides, the map features are shared across all agents by introducing a selective gate-mechanism. And finally, the trajectories of multiple agents are predicted simultaneously. Validations using both urban and highway driving datasets show that the proposed model can realize simultaneous trajectory predictions for multiple agents under complex traffic situations, and achieve state-of-the-art performance with respect to prediction accuracy. The achieved final displacement error (FDE@3sec) is 0.66 meter under urban driving, demonstrating the feasibility and effectiveness of the proposed approach.

Rapid Vehicle Trajectory Prediction Based on Multi-Attention Mechanism for Fusing Multimodal Information

Enhanced Multimodal Trajectory Prediction for Autonomous Vehicles Using Advanced Diffusion Model Techniques

A multi-modal spatial–temporal model for accurate motion forecasting with visual fusion

Multi-Interaction Trajectory Prediction Method With Serial Attention Patterns for Intelligent Vehicles

Adaptive Graph and Multi-Head Attention-Based Vehicle Trajectory Prediction

A multimodal vehicle trajectory prediction method with spatio-temporal feature fusion

A Hybrid Trajectory Prediction Framework for Automated Vehicles with Attention Mechanisms

Traffic Agent Trajectory Prediction Using Social Convolution and Attention Mechanism

Multi-Agent Trajectory Prediction With Heterogeneous Edge-Enhanced Graph Attention Network

MFTraj: Map-Free, Behavior-Driven Trajectory Prediction for Autonomous Driving

Trajectory Prediction Network of Autonomous Vehicles with Fusion of Historical Interactive Features

Multimodal Trajectory Prediction for Diverse Vehicle Types in Autonomous Driving with Heterogeneous Data and Physical Constraints

Multi-Vehicle Collaborative Learning for Trajectory Prediction With Spatio-Temporal Tensor Fusion

Multi‐modal Vehicle Trajectory Prediction Based on Mutual Information

Multi-modal Vehicle Trajectory Prediction Via Attention-based Conditional Variational Autoencoder

Simultaneous Past and Current Social Interaction-aware Trajectory Prediction for Multiple Intelligent Agents in Dynamic Scenes

Trajectory Prediction in the Complex Junction Scene Using Information Fusion and Behavior Pattern Recognition

GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Model

A Fast and Map-Free Model for Trajectory Prediction in Traffics

Trajectory Prediction for Autonomous Driving Based on Multiscale Spatial‐temporal Graph

MDSTF: a multi-dimensional spatio-temporal feature fusion trajectory prediction model for autonomous driving