Abstract:Collision risk assessment aims to provide a subjective cognitive comprehension of the risk level in driving scenarios, which is critical for the safety of autonomous driving systems. Pedestrian crossing scenarios contain intricate human-vehicle interactions. Hence, it is important to capture the rich relations between traffic entities and to assess the collision risk promptly to ensure safety. Existing studies focus on modeling the spatial relationships between the ego-vehicle and other vehicles in typical traffic scenarios, while ignoring the complex interactions between pedestrians and the ego-vehicle in critical driving scenarios. To address this issue, we propose a novel approach that involves constructing traffic scene graphs with enhanced vehicle-pedestrian interactions, along with introducing an innovative deep model built upon Transformer and GCN for pedestrian collision risk assessment. Specifically, to facilitate spatio-temporal modeling of traffic scene graph sequence, we propose a novel unified framework that integrates Multi-Relation Graph Convolution Network (MR-GCN) and Temporal Transformer Encoder. In addition, two variants of traffic scene graph datasets termed as Interaction-Enhanced Scene Graph (IESG) and None-Interaction-Enhanced Scene Graph (Non-IESG) are created for the purpose of assessing pedestrian collision risk, utilizing the CAP-DATA and JAAD respectively. Experiments are conducted on our newly created traffic scene graph datasets of pedestrian crossing scenes. The results on the IESG dataset show that our model outperforms the baseline model with higher accuracy (94% vs. 84%), higher AUC (98% vs. 89%), and higher F1-score (93% vs. 84%). IESG and Non-IESG datasets are available at https://github.com/Pedestrian-Crossing-Collision-Risk-Assessment-Datasets .

PIT: Progressive Interaction Transformer for Pedestrian Crossing Intention Prediction

Faster pedestrian crossing intention prediction based on efficient fusion of diverse intention influencing factors

GTransPDM: A Graph-embedded Transformer with Positional Decoupling for Pedestrian Crossing Intention Prediction

Spatio-temporal Interactive Pedestrian Intention Prediction with Illumination Transformation

Coupling Intent and Action for Pedestrian Crossing Behavior Prediction

Crossmodal Transformer Based Generative Framework for Pedestrian Trajectory Prediction

Pedestrian Intention Prediction Based on Traffic-Aware Scene Graph Model.

Pedestrian Crossing Intention Prediction Based on Cross-Modal Transformer and Uncertainty-Aware Multi-Task Learning for Autonomous Driving

Predicting Pedestrian Crossing Intention with Feature Fusion and Spatio-Temporal Attention

TAT: Pedestrian Intention and Trajectory Prediction

Explainable Pedestrian Crossing Intention Prediction Based on Multi-Task Mutual Guidance Network

Learning from Interaction-Enhanced Scene Graph for Pedestrian Collision Risk Assessment

Pedestrian Crossing Intention Prediction From Surveillance Videos for Over-the-Horizon Safety Warning

High Efficiency Pedestrian Crossing Prediction

Action-ViT: Pedestrian Intent Prediction in Traffic Scenes

Pedestrian Crossing Intention Prediction Model Considering Social Interaction between Multi-Pedestrians and Multi-Vehicles

Interpretable Prediction of Pedestrian Crossing Intention: Fusion of Human Skeletal Information in Natural Driving Scenarios

Crossing-Road Pedestrian Trajectory Prediction Based on Intention and Behavior Identification

Context-aware Multi-task Learning for Pedestrian Intent and Trajectory Prediction

ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving

PIP-Net: Pedestrian Intention Prediction in the Wild