Abstract:Along with the development of modern smart cities, human-centric video analysis has been encountering the challenge of analyzing diverse and complex events in real scenes. A complex event relates to dense crowds, anomalous individuals, or collective behaviors. However, limited by the scale and coverage of existing video datasets, few human analysis approaches have reported their performances on such complex events. To this end, we present a new large-scale dataset with comprehensive annotations, named Human-in-Events or HiEve (Human-centric video analysis in complex Events), for the understanding of human motions, poses, and actions in a variety of realistic events, especially in crowd & complex events. It contains a record number of poses (>1M), the largest number of action instances (>56k) under complex events, as well as one of the largest numbers of trajectories lasting for longer time (with an average trajectory length of >480 frames). Based on its diverse annotation, we present two simple baselines for action recognition and pose estimation, respectively. They leverage cross-label information during training to enhance the feature learning in corresponding visual tasks. Experiments show that they could boost the performance of existing action recognition and pose estimation pipelines. More importantly, they prove the widely ranged annotations in HiEve can improve various video tasks. Furthermore, we conduct extensive experiments to benchmark recent video analysis approaches together with our baseline methods, demonstrating HiEve is a challenging dataset for human-centric video analysis. We expect that the dataset will advance the development of cutting-edge techniques in human-centric analysis and the understanding of complex events. The dataset is available at <a class="link-external link-http" href="http://humaninevents.org" rel="external noopener nofollow">this http URL</a>

HiEve ACM MM Grand Challenge 2020: Pose Tracking in Crowded Scenes

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

A Simple Baseline for Pose Tracking in Videos of Crowded Scenes

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

A Simple Baseline for Pose Tracking in Videos of Crowed Scenes

Robust Object Tracking with a Hierarchical Ensemble Framework

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

A Top-down Approach to Articulated Human Pose Estimation and Tracking

Dense Scene Multiple Object Tracking with Box-Plane Matching

The 1st-place Solution for ECCV 2022 Multiple People Tracking in Group Dance Challenge

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Towards Accurate Human Pose Estimation in Videos of Crowded Scenes

Real-time 3D Deep Multi-Camera Tracking

Multi-Person Articulated Tracking With Spatial and Temporal Embeddings

Skeleton Cluster Tracking for robust multi-view multi-person 3D human pose estimation

Human in Events: A Large-Scale Benchmark for Human-centric Video Analysis in Complex Events

The Second-place Solution for ECCV 2022 Multiple People Tracking in Group Dance Challenge

Multi-Person Pose Tracking With Sparse Key-Point Flow Estimation and Hierarchical Graph Distance Minimization

MMPTRACK: Large-scale Densely Annotated Multi-camera Multiple People Tracking Benchmark