Abstract:This study proposes an agent‐centric approach to accurately predict the trajectory of autonomous vehicles. The approach utilizes an adaptive receptive field that adjusts to the agent's velocity and rotation, focusing attention on relevant surroundings. Additionally, perception encoding divides agents or lanes into levels, allowing for the efficient encoding of complex spatial relationships. The proposed method combines these advancements with transformer modelling, achieving better performance than the state‐of‐the‐art baseline and enhancing the safety and efficiency of autonomous driving systems by accurately predicting diverse and multimodal trajectories. The ability to predict the trajectory of an autonomous vehicle accurately is crucial for safe and efficient navigation. However, predicting diverse and multimodal futures can be challenging. Recent approaches such as attention and graph neural networks have achieved state‐of‐the‐art performance by considering agent interactions and map contexts. This study focused on multi‐agent prediction using an agent‐centric approach with transformers. This enables parallel computation and a comprehensive understanding of the environment. Two main features are introduced: an adaptive receptive field (ARF) that captures the relevant surroundings for each agent, and perception encoding, which serves as spatial context embeddings. The ARF adapts to the agent's velocity and rotation, focusing attention ahead at high speeds or to the sides when it is slower. Perception encoding divides agents or lanes into levels and encodes the information of each level. This approach enables the efficient encoding of complex spatial relationships. The proposed method combines these advances with transformer modelling for multi‐agent trajectory prediction while ensuring real‐time prediction capabilities. The approach is evaluated on the Argoverse benchmark and better performance than the state‐of‐the‐art baseline is achieved. By addressing challenges such as multimodal outputs and robustness, the study enhances the safety and efficiency of autonomous driving systems by more accurately predicting trajectories.

LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Prediction

Dynamic-learning Spatial-Temporal Transformer Network for Vehicular Trajectory Prediction at Urban Intersections

Multi‐agent trajectory prediction with adaptive perception‐guided transformers

Context‐aware trajectory prediction for autonomous driving in heterogeneous environments

Trajectory Prediction for Autonomous Driving Using a Transformer Network

Multi‐future Transformer: Learning Diverse Interaction Modes for Behaviour Prediction in Autonomous Driving

Edge-enriched Graph Transformer for Multi-Agent Trajectory Prediction with Relative Positional Semantics

Edge-Enriched Graph Transformer for Multiagent Trajectory Prediction With Relative Positional Semantics

TrajectoFormer: Transformer-Based Trajectory Prediction of Autonomous Vehicles with Spatio-temporal Neighborhood Considerations

SocialFormer: Social Interaction Modeling with Edge-enhanced Heterogeneous Graph Transformers for Trajectory Prediction

Agents-Separated Prediction-Former: A Novel Multi-Agent Trajectory Prediction Model Based on Transformer with 2D Input

Multi-Agent Tensor Fusion for Contextual Trajectory Prediction

Single-Agent LSTM Encoders Single-Agent LSTM Decoders Output : Multi-Agent Future Trajectories Input 1 : Multi-Agent Past Trajectories Input 2 : Scene Context Image Scene Context Channels Multi-Agent Channels Convolutional Operator : Multi-Agent Tensor Fusion

Spatio-Temporal Context Graph Transformer Design for Map-Free Multi-Agent Trajectory Prediction

A Hierarchical Hybrid Learning Framework for Multi-Agent Trajectory Prediction

HSTR: Hierarchical Scene Transformer for Multi-agent Trajectory Prediction*

Crossmodal Transformer Based Generative Framework for Pedestrian Trajectory Prediction

MacFormer: Map-Agent Coupled Transformer for Real-Time and Robust Trajectory Prediction

Spatial and social situation-aware transformer-based trajectory prediction of autonomous systems

Interaction-Aware Trajectory Prediction with Point Transformer