Abstract:Predicting the trajectory of the ego vehicle is a critical task for autonomous vehicles. Even though traffic regulations have defined boundaries, various behaviors of the agents in real-life situations introduce complexities that are hard to capture comprehensively. This has led to a rising curiosity in ego vehicle trajectory prediction based on learning techniques. In this paper, we introduce BEVSeg2GTA (Bird's-Eye-View Joint Vehicle Segmentation and Graph Neural Network Trajectory Prediction), a novel approach that aims to forecast trajectories by treating perception and trajectory prediction as interconnected elements of a single system. By integrating these tasks, we demonstrate the possibility of improving perception accuracy and trajectory prediction error. Initially, an encoder-decoder transformer-based deep network is employed to convert the multi-view camera images to a Bird's-Eye-View representation followed by semantic segmentation of crucial agents, including the ego vehicle, other vehicles, and pedestrians within the scene. Integrating state-of-the-art backbone (such as EfficientNet) facilitates the extraction of strong features, which are used to construct a graph wherein a node represents each object within the scene. Subsequently, the connections of these nodes are established by a k-Nearest Neighbors algorithm based on the distance metric. Further, the node and image features are fed into a Graph Neural Network to learn the complex relationships between agents in a spatial context. Finally, the Graph Neural Network learned features are passed to a Spatio-Temporal Probabilistic Network to predict the ego vehicle's future trajectory accurately. The proposed framework, BEVSeg2GTA, has been extensively evaluated on nuScenes datasets. The results demonstrate that the proposed method improves the state-of-the-art performance.

Optimizing Ego Vehicle Trajectory Prediction: The Graph Enhancement Approach

BEVSeg2GTA: Joint Vehicle Segmentation and Graph Neural Networks for Ego Vehicle Trajectory Prediction in Bird's-Eye-View

BEVSeg2TP: Surround View Camera Bird's-Eye-View Based Joint Vehicle Segmentation and Ego Vehicle Trajectory Prediction

A Cognition‐inspired Trajectory Prediction Method for Vehicles in Interactive Scenarios

Deep Perspective Transformation Based Vehicle Localization on Bird's Eye View

Predictive Neural Motion Planner for Autonomous Driving Using Graph Networks

Dynamic Vehicle Graph Interaction for Trajectory Prediction Based on Video Signals

Pioneering SE(2)-Equivariant Trajectory Planning for Automated Driving

Trajectory Planning for Autonomous Driving in Unstructured Scenarios Based on Graph Neural Network and Numerical Optimization

Trajectory Prediction from EGO View: A Coordinate Transform and Tail-Light Event Driven Approach

Look Before You Drive: Boosting Trajectory Forecasting via Imagining Future

EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Prediction

Graph-based Planning-informed Trajectory Prediction for Autonomous Driving

PLOP: Probabilistic poLynomial Objects trajectory Planning for autonomous driving

HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction Via Scene Encoding

Graph and Recurrent Neural Network-based Vehicle Trajectory Prediction For Highway Driving

Ego Vehicle Trajectory Prediction Based on Time-Feature Encoding and Physics-Intention Decoding

Decouple Ego-View Motions for Predicting Pedestrian Trajectory and Intention

Vehicle Interactive Dynamic Graph Neural Network Based Trajectory Prediction for Internet of Vehicles

Human Observation-Inspired Trajectory Prediction for Autonomous Driving in Mixed-Autonomy Traffic Environments

Trajectory Prediction for Autonomous Driving using Agent-Interaction Graph Embedding