Abstract:It is challenging to precisely predict pedestrian crossing intentions in autonomous driving, which requires combining changing traffic scene with dynamic pedestrian behaviors. Past studies have always resorted to pedestrians' historical behaviors to forecast their crossing intentions. However, pedestrians' crossing intentions are more related to their future behaviors. Moreover, deep learning-based crossing intention prediction lacks interpretability, limiting the practical application in intelligent vehicles. To tackle the mentioned issues, we propose a MultiTask Mutual Guidance Network (MTMGN), which optimizes the primary task of pedestrian crossing intention prediction by introducing an auxiliary task of pedestrian posture generation. The crossing intention prediction task consists of two modules: (1) A multi-source input fusion module is proposed to extract context-constraint features based on multiple inputs, including historical pedestrian postures, semantic segmentation maps, and pedestrian-vehicle distances. (2) A future posture injection module is proposed to forecast whether the pedestrian will cross based on context-constraint features and generated future postures. The pedestrian posture generation task leverages the conditional diffusion model to generate future pedestrian postures that adhere to the traffic scene based on the extracted context-constraint features. MTMGN is evaluated on two public datasets, JAAD and PIE, with F1/Recall values of 73%/89% and 92%/90%, respectively. Both qualitative and quantitative evaluations indicate that MTMGN can precisely anticipate pedestrians' crossing intentions, benefitting from the generated pedestrian postures. Moreover, the generated postures provide intuitionistic interpretability for crossing intention prediction.

Social Aware Multi-modal Pedestrian Crossing Behavior Prediction.

Analysis and Prediction of Pedestrians' Violation Behavior at the Intersection Based on a Markov Chain

Pedestrian Crossing Intention Prediction Model Considering Social Interaction between Multi-Pedestrians and Multi-Vehicles

Multi-Modal Hybrid Architecture for Pedestrian Action Prediction

CR-LSTM: Collision-prior Guided Social Refinement for Pedestrian Trajectory Prediction

Coupling Intent and Action for Pedestrian Crossing Behavior Prediction

High Efficiency Pedestrian Crossing Prediction

Prediction of Pedestrian Crossing Behavior Based on Surveillance Video

SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Prediction

Crossmodal Transformer Based Generative Framework for Pedestrian Trajectory Prediction

Pedestrian Crossing Intention Prediction From Surveillance Videos for Over-the-Horizon Safety Warning

Explainable Pedestrian Crossing Intention Prediction Based on Multi-Task Mutual Guidance Network

Pedestrian Behavior Prediction Method for Intelligent Vehicles Based on Convolutional Neural Network

Cross or Wait? Predicting Pedestrian Interaction Outcomes at Unsignalized Crossings

PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learning

Graph-SIM: A Graph-based Spatiotemporal Interaction Modelling for Pedestrian Action Prediction

Crossing-Road Pedestrian Trajectory Prediction Based on Intention and Behavior Identification

Multi-Relational Pedestrian Trajectory Prediction in Complex Scenes.

Predicting Pedestrian Crossing Intention with Feature Fusion and Spatio-Temporal Attention

Pedestrian Intention Prediction Based on Traffic-Aware Scene Graph Model.

Predicting and Analyzing Pedestrian Crossing Behavior at Unsignalized Crossings