Abstract:We describe a method for articulated human detection and human pose estimation in static images based on a new representation of deformable part models. Rather than modeling articulation using a family of warped (rotated and foreshortened) templates, we use a mixture of small, nonoriented parts. We describe a general, flexible mixture model that jointly captures spatial relations between part locations and co-occurrence relations between part mixtures, augmenting standard pictorial structure models that encode just spatial relations. Our models have several notable properties: 1) They efficiently model articulation by sharing computation across similar warps, 2) they efficiently model an exponentially large set of global mixtures through composition of local mixtures, and 3) they capture the dependency of global geometry on local appearance (parts look different at different locations). When relations are tree structured, our models can be efficiently optimized with dynamic programming. We learn all parameters, including local appearances, spatial relations, and co-occurrence relations (which encode local rigidity) with a structured SVM solver. Because our model is efficient enough to be used as a detector that searches over scales and image locations, we introduce novel criteria for evaluating pose estimation and human detection, both separately and jointly. We show that currently used evaluation criteria may conflate these two issues. Most previous approaches model limbs with rigid and articulated templates that are trained independently of each other, while we present an extensive diagnostic evaluation that suggests that flexible structure and joint training are crucial for strong performance. We present experimental results on standard benchmarks that suggest our approach is the state-of-the-art system for pose estimation, improving past work on the challenging Parse and Buffy datasets while being orders of magnitude faster.

Joint Parsing And Segmentation Of Articulated Human Bodies From Videos

Discriminative Hierarchical Part-Based Models for Human Parsing and Action Recognition.

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

Real-Time Human Segmentation Using Pose Skeleton Map

MOtion Human Parsing - A New Benchmark for 3D Human Parsing.

Upper Body Human Detection and Segmentation in Low Contrast Video

A Human Body Part Semantic Segmentation Enabled Parsing for Human Pose Estimation

Joint Multi-Person Pose Estimation and Semantic Part Segmentation

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Joint Action Recognition And Pose Estimation From Video

Articulated Human Detection with Flexible Mixtures of Parts

Non-rigid Video Object Segmentation Based on Semantic Multi-level Framework.

Robust Human Body Segmentation Based on Part Appearance and Spatial Constraint

Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images

A Semi-supervised Clustering-based Segmentation Algorithm of 3D Reconstructed Human Body Parts

3D joints estimation of human body using part segmentation

Scene-Centric Joint Parsing of Cross-View Videos.

Shape and Pose Estimation for Closely Interacting Persons Using Multi-view Images.

Scene-Centric Joint Parsing of Cross-View Videos

Single-stage Multi-human Parsing via Point Sets and Center-based Offsets