Abstract:Human pose estimation is a critical component in autonomous driving and parking, enhancing safety by predicting human actions. Traditional frame-based cameras and videos are commonly applied, yet, they become less reliable in scenarios under high dynamic range or heavy motion blur. In contrast, event cameras offer a robust solution for navigating these challenging contexts. Predominant methodologies incorporate event cameras into learning frameworks by accumulating events into event frames. However, such methods tend to marginalize the intrinsic asynchronous and high temporal resolution characteristics of events. This disregard leads to a loss in essential temporal dimension data, crucial for safety-critical tasks associated with dynamic human activities. To address this issue and to unlock the 3D potential of event information, we introduce two 3D event representations: the Rasterized Event Point Cloud (RasEPC) and the Decoupled Event Voxel (DEV). The RasEPC collates events within concise temporal slices at identical positions, preserving 3D attributes with statistical cues and markedly mitigating memory and computational demands. Meanwhile, the DEV representation discretizes events into voxels and projects them across three orthogonal planes, utilizing decoupled event attention to retrieve 3D cues from the 2D planes. Furthermore, we develop and release EV-3DPW, a synthetic event-based dataset crafted to facilitate training and quantitative analysis in outdoor scenes. On the public real-world DHP19 dataset, our event point cloud technique excels in real-time mobile predictions, while the decoupled event voxel method achieves the highest accuracy. Experiments reveal our proposed 3D representation methods' superior generalization capacities against traditional RGB images and event frame techniques. Our code and dataset are available at https://github.com/MasterHow/EventPointPose.

Dpm Revisited: Utilizing Root-Part Spatial Distribution for Vehicle Viewpoint Estimation

On-road Vehicle Detection Through Part Model Learning and Probabilistic Inference

Rethinking Human Pose Estimation for Autonomous Driving with 3D Event Representations.

Viewpoint Alignment and Discriminative Parts Enhancement in 3D Space for Vehicle ReID

Robust Vehicle Detection and Viewpoint Estimation with Soft Discriminative Mixture Model

KPV3D: Enhancing Multiview 3-D Vehicle Detection With 2-D Keypoint Priors

Vehicle Detection by Fusing Part Model Learning and Semantic Scene Information for Complex Urban Surveillance

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

Multi-View Vehicle Detection Based on Fusion Part Model With Active Learning

Fine-grained Feature Alignment with Part Perspective Transformation for Vehicle ReID.

Discriminative-region attention and orthogonal-view generation model for vehicle re-identification

A Part-Based Gaussian Reweighted Approach for Occluded Vehicle Detection

Part-based On-Road Vehicle Detection Using Hidden Random Field

DVPE: Divided View Position Embedding for Multi-View 3D Object Detection

Image Guidance Based 3D Vehicle Detection in Traffic Scene.

A DPM Based Approach to Joint Object Detection and Sub-category Recognition

Discriminative Feature Representation with Spatio-temporal Cues for Vehicle Re-identification

Viewpoint-aware Progressive Clustering for Unsupervised Vehicle Re-identification

An Efficient Wide-Range Pseudo-3D Vehicle Detection Using A Single Camera

3D Extended Object Tracking by Fusing Roadside Sparse Radar Point Clouds and Pixel Keypoints

Discriminative feature and dictionary learning with part-aware model for vehicle re-identification