Abstract:We describe a method for articulated human detection and human pose estimation in static images based on a new representation of deformable part models. Rather than modeling articulation using a family of warped (rotated and foreshortened) templates, we use a mixture of small, nonoriented parts. We describe a general, flexible mixture model that jointly captures spatial relations between part locations and co-occurrence relations between part mixtures, augmenting standard pictorial structure models that encode just spatial relations. Our models have several notable properties: 1) They efficiently model articulation by sharing computation across similar warps, 2) they efficiently model an exponentially large set of global mixtures through composition of local mixtures, and 3) they capture the dependency of global geometry on local appearance (parts look different at different locations). When relations are tree structured, our models can be efficiently optimized with dynamic programming. We learn all parameters, including local appearances, spatial relations, and co-occurrence relations (which encode local rigidity) with a structured SVM solver. Because our model is efficient enough to be used as a detector that searches over scales and image locations, we introduce novel criteria for evaluating pose estimation and human detection, both separately and jointly. We show that currently used evaluation criteria may conflate these two issues. Most previous approaches model limbs with rigid and articulated templates that are trained independently of each other, while we present an extensive diagnostic evaluation that suggests that flexible structure and joint training are crucial for strong performance. We present experimental results on standard benchmarks that suggest our approach is the state-of-the-art system for pose estimation, improving past work on the challenging Parse and Buffy datasets while being orders of magnitude faster.

Balanced Mixture of Deformable Part Models with Automatic Part Configurations.

MPLBoost-based Mixture Model for Effective Human Detection with Deformable Part Model

CDPM: Convolutional Deformable Part Models for Semantically Aligned Person Re-Identification

Articulated Human Detection with Flexible Mixtures of Parts

CDPM: Convolutional Deformable Part Models for Person Re-identification

Object Detection with Discriminatively Trained Part Based Models

Active Deformable Part Models

Enhanced Deformable Part Model for Pedestrian Detection Via Joint State Inference

An Empirical Study of Deformable Part Model with Fast Feature Pyramid

Deformable Part-Based Model Transfer for Object Detection.

Training Mixture of Weighted SVM for Object Detection Using EM Algorithm

Human Detection Method Based on Multi-Part Detector and Multi-Instance Learning

Discriminatively Trained Part Based Model Armed with Biased Saliency

A DPM Based Approach to Joint Object Detection and Sub-category Recognition

Improved Deformable Part Model for Object Detection Based on Scale Invariant Feature Transform

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Object Tracking with Embedded Deformable Parts in Dynamic Conditional Random Fields

Weighted Deformable Part Model for Robust Human Detection

Pose and Shape Estimation with Discriminatively Learned Parts

DeformPAM: Data-Efficient Learning for Long-horizon Deformable Object Manipulation via Preference-based Action Alignment

Articulated pose estimation with flexible mixtures-of-parts