Abstract:Human pose estimation is a critical component in autonomous driving and parking, enhancing safety by predicting human actions. Traditional frame-based cameras and videos are commonly applied, yet, they become less reliable in scenarios under high dynamic range or heavy motion blur. In contrast, event cameras offer a robust solution for navigating these challenging contexts. Predominant methodologies incorporate event cameras into learning frameworks by accumulating events into event frames. However, such methods tend to marginalize the intrinsic asynchronous and high temporal resolution characteristics of events. This disregard leads to a loss in essential temporal dimension data, crucial for safety-critical tasks associated with dynamic human activities. To address this issue and to unlock the 3D potential of event information, we introduce two 3D event representations: the Rasterized Event Point Cloud (RasEPC) and the Decoupled Event Voxel (DEV). The RasEPC collates events within concise temporal slices at identical positions, preserving 3D attributes with statistical cues and markedly mitigating memory and computational demands. Meanwhile, the DEV representation discretizes events into voxels and projects them across three orthogonal planes, utilizing decoupled event attention to retrieve 3D cues from the 2D planes. Furthermore, we develop and release EV-3DPW, a synthetic event-based dataset crafted to facilitate training and quantitative analysis in outdoor scenes. On the public real-world DHP19 dataset, our event point cloud technique excels in real-time mobile predictions, while the decoupled event voxel method achieves the highest accuracy. Experiments reveal our proposed 3D representation methods' superior generalization capacities against traditional RGB images and event frame techniques. Our code and dataset are available at https://github.com/MasterHow/EventPointPose.

Synchronized Data Collection for Human Group Recognition

Recognition of interactive human groups from mobile sensing data

Research on Student Group Tracking Algorithm Based on Teaching Scene

Rethinking Human Pose Estimation for Autonomous Driving with 3D Event Representations.

Understanding Step Synchronization in Social Groups: A Novel Method to Recognize Group

Who Walks With You Matters: Perceiving Social Interactions with Groups for Pedestrian Trajectory Prediction

Real-time Trajectory-based Social Group Detection

High Fidelity Human Trajectory Tracking Based on Surveillance Camera Data

Social Group Detection Based on Multi-Level Consistent Behaviour Characteristics

Automatic Identification of Human Subgroups in Time-Dependent Pedestrian Flow Networks

Semantic Trajectory Based Behavior Generation for Groups Identification

Self-supervised Social Relation Representation for Human Group Detection

High-performance spatiotemporal trajectory matching across heterogeneous data sources

Identification of a Person in a Trajectory Based on Wearable Sensor Data Analysis

Emergency-Oriented Spatiotemporal Trajectory Pattern Recognition by Intelligent Sensor Devices.

Kinects and Human Kinetics: A New Approach for Studying Crowd Behavior

Together or Alone: Detecting Group Mobility with Wireless Fingerprints

Robust Trajectory Estimation for Crowdsourcing-Based Mobile Applications

Online Discovery of Evolving Groups over Massive-Scale Trajectory Streams

Group Event Detection with a Varying Number of Group Members for Video Surveillance

Fuzzy Spatiotemporal Representation Model for Human Trajectory Classification