Abstract:Accurate anticipation of pedestrian crossing intentions is critical for preventing pedestrian-vehicle conflicts and ensuring road safety. This issue is a significant focus in intelligent transportation systems and autonomous driving. However, current approaches often face challenges, such as high computational costs due to complex scene understanding and inadequate consideration of spatiotemporal dependencies in pedestrian actions. To handle these challenges, we propose RAIDN (real-time action-interaction dual-branch network), which comprises the pedestrian action encoding and traffic-object interaction modules to anticipate pedestrian crossing intentions in real time. The pedestrian action encoding module employs a multi-scale graph transformer, efficiently extracting the intrinsic topology of long-and short-term action variations. This module effectively addresses issues of information redundancy in multi-channel graph convolution networks and local limitations in multi-scale temporal convolutions. Subsequently, the traffic-object interaction module introduces an interaction relation graph convolution network to excavate relevant traffic-object interactions, thereby shortening the prolonged scene semantic inference. Finally, global average pooling and attention layers fuse the action and interaction cues for real-time intention anticipation. The effectiveness of RAIDN has been validated on public datasets JAAD and PIE, achieving competitive metrics with Accuracy, ROC-AUC, F1-Score, Precision, and Recall rates of 0.89/0.92, 0.80/0.89, 0.66/0.85, 0.65/0.82, and 0.72/0.89 respectively. Notably, RAIDN demonstrates a remarkable inference time of just 0.28ms, outperforming other state-of-the-art methods and establishing its suitability for real-time applications in intelligent transportation and autonomous driving.

DPCIAN: A Novel Dual-Channel Pedestrian Crossing Intention Anticipation Network

Real-Time Pedestrian Crossing Anticipation Based on an Action–Interaction Dual-Branch Network

An Efficient Multi-Task Network for Pedestrian Intrusion Detection

Pedestrians Crossing Intention Anticipation Based on Dual‐channel Action Recognition and Hierarchical Environmental Context

Crossing or Not? Context-Based Recognition of Pedestrian Crossing Intention in the Urban Environment

Faster pedestrian crossing intention prediction based on efficient fusion of diverse intention influencing factors

PIDNet: an Efficient Network for Dynamic Pedestrian Intrusion Detection

Coupling Intent and Action for Pedestrian Crossing Behavior Prediction

Predicting Pedestrian Crossing Intention with Feature Fusion and Spatio-Temporal Attention

High Efficiency Pedestrian Crossing Prediction

A Pedestrian Trajectory Prediction Network Based on Trajectory Conditional Visual Attention

DTDNet: Dynamic Target Driven Network for pedestrian trajectory prediction

Dual-branch Self-Attention Network for Pedestrian Attribute Recognition

Explainable Pedestrian Crossing Intention Prediction Based on Multi-Task Mutual Guidance Network

GTransPDM: A Graph-embedded Transformer with Positional Decoupling for Pedestrian Crossing Intention Prediction

Pedestrian Detection via Body Part Semantic and Contextual Information With DNN

Synthetic Data Generation Framework, Dataset, and Efficient Deep Model for Pedestrian Intention Prediction

Pedestrian Crossing Intention Prediction From Surveillance Videos for Over-the-Horizon Safety Warning

Social Aware Multi-modal Pedestrian Crossing Behavior Prediction.

Analysis of pedestrian second crossing behavior based on physics-informed neural networks

Crossing-Road Pedestrian Trajectory Prediction Based on Intention and Behavior Identification