Abstract:This study proposes an agent‐centric approach to accurately predict the trajectory of autonomous vehicles. The approach utilizes an adaptive receptive field that adjusts to the agent's velocity and rotation, focusing attention on relevant surroundings. Additionally, perception encoding divides agents or lanes into levels, allowing for the efficient encoding of complex spatial relationships. The proposed method combines these advancements with transformer modelling, achieving better performance than the state‐of‐the‐art baseline and enhancing the safety and efficiency of autonomous driving systems by accurately predicting diverse and multimodal trajectories. The ability to predict the trajectory of an autonomous vehicle accurately is crucial for safe and efficient navigation. However, predicting diverse and multimodal futures can be challenging. Recent approaches such as attention and graph neural networks have achieved state‐of‐the‐art performance by considering agent interactions and map contexts. This study focused on multi‐agent prediction using an agent‐centric approach with transformers. This enables parallel computation and a comprehensive understanding of the environment. Two main features are introduced: an adaptive receptive field (ARF) that captures the relevant surroundings for each agent, and perception encoding, which serves as spatial context embeddings. The ARF adapts to the agent's velocity and rotation, focusing attention ahead at high speeds or to the sides when it is slower. Perception encoding divides agents or lanes into levels and encodes the information of each level. This approach enables the efficient encoding of complex spatial relationships. The proposed method combines these advances with transformer modelling for multi‐agent trajectory prediction while ensuring real‐time prediction capabilities. The approach is evaluated on the Argoverse benchmark and better performance than the state‐of‐the‐art baseline is achieved. By addressing challenges such as multimodal outputs and robustness, the study enhances the safety and efficiency of autonomous driving systems by more accurately predicting trajectories.

A Multi-task Transformer Architecture for Drone State Identification and Trajectory Prediction

A Multi-task Learning Framework for Drone State Identification and Trajectory Prediction

Dynamic-learning Spatial-Temporal Transformer Network for Vehicular Trajectory Prediction at Urban Intersections

End-to-end multiple object tracking in high-resolution optical sensors of drones with transformer models

Cross-Parallel Attention and Efficient Match Transformer for Aerial Tracking

TAFormer: A Unified Target-Aware Transformer for Video and Motion Joint Prediction in Aerial Scenes

Multi-Task Regression-Based Learning for Autonomous Unmanned Aerial Vehicle Flight Control Within Unstructured Outdoor Environments

Enhanced Social Trajectory Prediction Transformer for L3 Highway Pilots

Drones Help Drones: A Collaborative Framework for Multi-Drone Object Trajectory Prediction and Beyond

Research on flight trajectory prediction method based on transformer

Data-Efficient Multirobot, Multitask Transfer Learning for Trajectory Tracking

LiDARFormer: A Unified Transformer-based Multi-task Network for LiDAR Perception

Multi‐agent trajectory prediction with adaptive perception‐guided transformers

Trajectory Prediction for Autonomous Driving Using a Transformer Network

TransVisDrone: Spatio-Temporal Transformer for Vision-based Drone-to-Drone Detection in Aerial Videos

LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Prediction

Drone-Based Visible–Thermal Object Detection with Transformers and Prompt Tuning

Exploring Transformer-Augmented LSTM for Temporal and Spatial Feature Learning in Trajectory Prediction

Adaptive and Background-Aware Vision Transformer for Real-Time UAV Tracking

Context‐aware trajectory prediction for autonomous driving in heterogeneous environments

YOLO-U: multi-task model for vehicle detection and road segmentation in UAV aerial imagery