Abstract:Human pose estimation is a critical component in autonomous driving and parking, enhancing safety by predicting human actions. Traditional frame-based cameras and videos are commonly applied, yet, they become less reliable in scenarios under high dynamic range or heavy motion blur. In contrast, event cameras offer a robust solution for navigating these challenging contexts. Predominant methodologies incorporate event cameras into learning frameworks by accumulating events into event frames. However, such methods tend to marginalize the intrinsic asynchronous and high temporal resolution characteristics of events. This disregard leads to a loss in essential temporal dimension data, crucial for safety-critical tasks associated with dynamic human activities. To address this issue and to unlock the 3D potential of event information, we introduce two 3D event representations: the Rasterized Event Point Cloud (RasEPC) and the Decoupled Event Voxel (DEV). The RasEPC collates events within concise temporal slices at identical positions, preserving 3D attributes with statistical cues and markedly mitigating memory and computational demands. Meanwhile, the DEV representation discretizes events into voxels and projects them across three orthogonal planes, utilizing decoupled event attention to retrieve 3D cues from the 2D planes. Furthermore, we develop and release EV-3DPW, a synthetic event-based dataset crafted to facilitate training and quantitative analysis in outdoor scenes. On the public real-world DHP19 dataset, our event point cloud technique excels in real-time mobile predictions, while the decoupled event voxel method achieves the highest accuracy. Experiments reveal our proposed 3D representation methods' superior generalization capacities against traditional RGB images and event frame techniques. Our code and dataset are available at https://github.com/MasterHow/EventPointPose.

Parsing the Hand Gesture of Traffic Police Officers by Using OpenPose

Visual Recognition of traffic police gestures with convolutional pose machine and handcrafted features

Rethinking Human Pose Estimation for Autonomous Driving with 3D Event Representations.

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Traffic Police 3D Gesture Recognition Based on Spatial–Temporal Fully Adaptive Graph Convolutional Network

Simple But Effective: Upper-Body Geometric Features for Traffic Command Gesture Recognition

Max-covering scheme for gesture recognition of Chinese traffic police

Low light recognition of traffic police gestures based on lightweight extraction of skeleton features

Gesture recognition of traffic police based on static and dynamic descriptor fusion

Dual-module spatial temporal information enhancement graph convolutional network for recognizing traffic police command gestures

Chinese Traffic Police Gesture Recognition Based on Graph Convolutional Network in Natural Scene

Skeleton-based Traffic Command Recognition at Road Intersections for Intelligent Vehicles

mm-TPG: Traffic Policemen Gesture Recognition Based on Millimeter Wave Radar Point Cloud

Traffic Control Gesture Recognition for Autonomous Vehicles

Traffic police command gesture recognition technology based on machine vision and two-stream spatio-temporal attention graph convolutional network

Action Recognition Framework in Traffic Scene for Autonomous Driving System.

Attention Mechanism Based on Improved Spatial-Temporal Convolutional Neural Networks for Traffic Police Gesture Recognition

Research on driver posture recognition and prediction in vehicle

Pose Estimation for Vehicles Based on Binocular Stereo Vision in Urban Traffic

Pose Estimation of Moving Vehicles Based on Heuristic Rules for Autonomous Driving

Vehicle-Human Interactive Behaviors in Emergency: Data Extraction from Traffic Accident Videos