Towards Accurate Human Pose Estimation in Videos of Crowded Scenes

Li Yuan,Shuning Chang,Xuecheng Nie,Ziyuan Huang,Yichen Zhou,Yunpeng Chen,Jiashi Feng,Shuicheng Yan

DOI: https://doi.org/10.1145/3394171.3416299

2020-10-21

Abstract:Video-based human pose estimation in crowded scenes is a challenging problem due to occlusion, motion blur, scale variation and viewpoint change, etc. Prior approaches always fail to deal with this problem because of (1) lacking of usage of temporal information; (2) lacking of training data in crowded scenes. In this paper, we focus on improving human pose estimation in videos of crowded scenes from the perspectives of exploiting temporal context and collecting new data. In particular, we first follow the top-down strategy to detect persons and perform single-person pose estimation for each frame. Then, we refine the frame-based pose estimation with temporal contexts deriving from the optical-flow. Specifically, for one frame, we forward the historical poses from the previous frames and backward the future poses from the subsequent frames to current frame, leading to stable and accurate human pose estimation in videos. In addition, we mine new data of similar scenes to HIE dataset from the Internet for improving the diversity of training set. In this way, our model achieves best performance on 7 out of 13 videos and 56.33 average w\_AP on test dataset of HIE challenge.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to perform accurate human pose estimation in crowded - scene videos. Due to factors such as occlusion, motion blur, scale variation and perspective change, human pose estimation in videos is a very challenging problem in crowded scenes. Previous methods are usually difficult to deal with this problem for the following two reasons: (1) lack of utilization of temporal information; (2) lack of training data in crowded scenes. Therefore, from the perspective of using temporal context and collecting new data, this paper aims to improve the effect of human pose estimation in crowded - scene videos.

Towards Accurate Human Pose Estimation in Videos of Crowded Scenes

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Toward Accurate Person-level Action Recognition in Videos of Crowed Scenes

Human pose estimation in crowded scenes using Keypoint Likelihood Variance Reduction

CC-PoseNet: Towards Human Pose Estimation in Crowded Classrooms

3D Human pose estimation from video via multi-scale multi-level spatial temporal features

An Effective 3D Human Pose Estimation Method Based on Dilated Convolutions for Videos.

3D Human Pose and Shape Estimation from Video

3D Human Pose Estimation using Spatio-Temporal Networks with Explicit Occlusion Training

Exploring Temporal Consistency for Human Pose Estimation in Videos

QuickPose: Real-time Multi-view Multi-person Pose Estimation in Crowded Scenes

CrowdPose: Efficient Crowded Scenes Pose Estimation and a New Benchmark

Towards Scalable Scenarios Human Pose Estimation Via Two-Stage Hierarchical Network

A Simple Baseline for Pose Tracking in Videos of Crowded Scenes

A Simple Baseline for Pose Tracking in Videos of Crowed Scenes

Deep Dual Consecutive Network for Human Pose Estimation

Robust 3D Human Pose Estimation from Single Images or Video Sequences

Human Pose Estimation in Monocular Omnidirectional Top-View Images

Occlusion-Aware Networks for 3D Human Pose Estimation in Video.