Abstract:Simultaneous trajectory prediction for multiple heterogeneous traffic participants is essential for safe and efficient operation of connected automated vehicles under complex driving situations. Two main challenges for this task are to handle the varying number of heterogeneous target agents and jointly consider multiple factors that would affect their future motions. This is because different kinds of agents have different motion patterns, and their behaviors are jointly affected by their individual dynamics, their interactions with surrounding agents, as well as the traffic infrastructures. A trajectory prediction method handling these challenges will benefit the downstream decision-making and planning modules of autonomous vehicles. To meet these challenges, we propose a three-channel framework together with a novel Heterogeneous Edge-enhanced graph ATtention network (HEAT). Our framework is able to deal with the heterogeneity of the target agents and traffic participants involved. Specifically, agents’ dynamics are extracted from their historical states using type-specific encoders. The inter-agent interactions are represented with a directed edge-featured heterogeneous graph and processed by the designed HEAT network to extract interaction features. Besides, the map features are shared across all agents by introducing a selective gate-mechanism. And finally, the trajectories of multiple agents are predicted simultaneously. Validations using both urban and highway driving datasets show that the proposed model can realize simultaneous trajectory predictions for multiple agents under complex traffic situations, and achieve state-of-the-art performance with respect to prediction accuracy. The achieved final displacement error (FDE@3sec) is 0.66 meter under urban driving, demonstrating the feasibility and effectiveness of the proposed approach.

Sparse Heterogeneous Interactions for Multi-Modal Trajectory Prediction

Multi-Agent Trajectory Prediction Based on Graph Neural Network

Enhanced Multimodal Trajectory Prediction for Autonomous Vehicles Using Advanced Diffusion Model Techniques

Interaction-Aware Trajectory Prediction with Point Transformer

Multi-Modal Vehicle Trajectory Prediction by Collaborative Learning of Lane Orientation, Vehicle Interaction, and Intention

Context‐aware trajectory prediction for autonomous driving in heterogeneous environments

HSTR: Hierarchical Scene Transformer for Multi-agent Trajectory Prediction*

Unlimited Neighborhood Interaction for Heterogeneous Trajectory Prediction

Spatio-Temporal-Interaction Graph Neural Networks for Multi-Agent Trajectory Prediction

Real-Time Heterogeneous Road-Agents Trajectory Prediction Using Hierarchical Convolutional Networks and Multi-task Learning

Map-free Trajectory Prediction in Traffic with Multi-level Spatial-temporal Modeling

Multi-Vehicle Collaborative Learning for Trajectory Prediction With Spatio-Temporal Tensor Fusion

Multimodal Interaction-Aware Trajectory Prediction in Crowded Space

Path-based Multimodal Trajectories Prediction

Edge-Enriched Graph Transformer for Multiagent Trajectory Prediction With Relative Positional Semantics

Multi-Interaction Trajectory Prediction Method With Serial Attention Patterns for Intelligent Vehicles

Edge-enriched Graph Transformer for Multi-Agent Trajectory Prediction with Relative Positional Semantics

A Hierarchical Hybrid Learning Framework for Multi-Agent Trajectory Prediction

Trajectory Prediction for Autonomous Driving Based on Multiscale Spatial‐temporal Graph

LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Prediction

Multi-Agent Trajectory Prediction With Heterogeneous Edge-Enhanced Graph Attention Network