Abstract:We introduce a new dataset, Human3.6M, of 3.6 Million accurate 3D Human poses, acquired by recording the performance of 5 female and 6 male subjects, under 4 different viewpoints, for training realistic human sensing systems and for evaluating the next generation of human pose estimation models and algorithms. Besides increasing the size of the datasets in the current state-of-the-art by several orders of magnitude, we also aim to complement such datasets with a diverse set of motions and poses encountered as part of typical human activities (taking photos, talking on the phone, posing, greeting, eating, etc.), with additional synchronized image, human motion capture, and time of flight (depth) data, and with accurate 3D body scans of all the subject actors involved. We also provide controlled mixed reality evaluation scenarios where 3D human models are animated using motion capture and inserted using correct 3D geometry, in complex real environments, viewed with moving cameras, and under occlusion. Finally, we provide a set of large-scale statistical models and detailed evaluation baselines for the dataset illustrating its diversity and the scope for improvement by future work in the research community. Our experiments show that our best large-scale model can leverage our full training set to obtain a 20% improvement in performance compared to a training set of the scale of the largest existing public dataset for this problem. Yet the potential for improvement by leveraging higher capacity, more complex models with our large dataset, is substantially vaster and should stimulate future research. The dataset together with code for the associated large-scale learning models, features, visualization tools, as well as the evaluation server, is available online at http://vision.imar.ro/human3.6m.

A Short Note on the Kinetics-700 Human Action Dataset

A Short Note on the Kinetics-700-2020 Human Action Dataset

The Kinetics Human Action Video Dataset

ActionCLIP: Adapting Language-Image Pretrained Models for Video Action Recognition.

AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale

The Magni Human Motion Dataset: Accurate, Complex, Multi-Modal, Natural, Semantically-Rich and Contextualized

Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances

Let's Dance: Learning From Online Dance Videos

DGU-HAO: A Dataset With Daily Life Objects for Comprehensive 3D Human Action Analysis

Sequence-to-Sequence Modeling for Action Identification at High Temporal Resolution

Visual Knowledge Graph for Human Action Reasoning in Videos

An Open-Access Database of Video Stimuli for Action Observation Research in Neuroimaging Settings: Psychometric Evaluation and Motion Characterization

Target-Specific Action Classification for Automated Assessment of Human Motor Behavior from Video

Kinematics Modeling Network for Video-based Human Pose Estimation

Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments

A Benchmark Dataset and Comparison Study for Multi-Modal Human Action Analytics

Egok360: A 360 Egocentric Kinetic Human Activity Video Dataset

Deep Learning-Based Human Action Recognition in Videos

EV-Action: Electromyography-Vision Multi-Modal Action Dataset