Abstract:Recent advancements in predicting pedestrian crossing intentions for Autonomous Vehicles using Computer Vision and Deep Neural Networks are promising. However, the black-box nature of DNNs poses challenges in understanding how the model works and how input features contribute to final predictions. This lack of interpretability delimits the trust in model performance and hinders informed decisions on feature selection, representation, and model optimisation; thereby affecting the efficacy of future research in the field. To address this, we introduce Context-aware Permutation Feature Importance (CAPFI), a novel approach tailored for pedestrian intention prediction. CAPFI enables more interpretability and reliable assessments of feature importance by leveraging subdivided scenario contexts, mitigating the randomness of feature values through targeted shuffling. This aims to reduce variance and prevent biased estimations in importance scores during permutations. We divide the Pedestrian Intention Estimation (PIE) dataset into 16 comparable context sets, measure the baseline performance of five distinct neural network architectures for intention prediction in each context, and assess input feature importance using CAPFI. We observed nuanced differences among models across various contextual characteristics. The research reveals the critical role of pedestrian bounding boxes and ego-vehicle speed in predicting pedestrian intentions, and potential prediction biases due to the speed feature through cross-context permutation evaluation. We propose an alternative feature representation by considering proximity change rate for rendering dynamic pedestrian-vehicle locomotion, thereby enhancing the contributions of input features to intention prediction. These findings underscore the importance of contextual features and their diversity to develop accurate and robust intent-predictive models.

Head Pose Based Intention Prediction Using Discrete Dynamic Bayesian Network

Modeling social interaction and intention for pedestrian trajectory prediction

A Data-Driven Approach for Pedestrian Intention Prediction in Large Public Places

Coupling Intent and Action for Pedestrian Crossing Behavior Prediction

Pedestrian Intention Prediction: A Multi-task Perspective

Spatio-temporal Interactive Pedestrian Intention Prediction with Illumination Transformation

DTDNet: Dynamic Target Driven Network for pedestrian trajectory prediction

Dynamic Bayesian Network Based Visual Focus of Attention Recognition

Local and Global Contextual Features Fusion for Pedestrian Intention Prediction

Gaze-based Human Intention Prediction in the Hybrid Foraging Search Task

Pedestrian Intention Prediction Based on Traffic-Aware Scene Graph Model.

Action-ViT: Pedestrian Intent Prediction in Traffic Scenes

TAT: Pedestrian Intention and Trajectory Prediction

Pedestrian Crossing Intention Prediction From Surveillance Videos for Over-the-Horizon Safety Warning

Feature Importance in Pedestrian Intention Prediction: A Context-Aware Review

Crossing-Road Pedestrian Trajectory Prediction Based on Intention and Behavior Identification

Explainable Pedestrian Crossing Intention Prediction Based on Multi-Task Mutual Guidance Network

Pedestrian Trajectory Prediction Based on an Intention Randomness Influence Strategy

On-Board Pedestrian Trajectory Prediction Using Behavioral Features

Roadside Pedestrian Motion Prediction Using Bayesian Methods and Particle Filter

Spatio-temporal deep learning framework for pedestrian intention prediction in urban traffic scenes