Abstract:Human pose estimation aims to figure out the keypoints of all people in different scenes. Current approaches still face some challenges despite promising results. Existing top-down methods deal with a single person individually, without the interaction between different people and the scene they are situated in. Consequently, the performance of human detection degrades when serious occlusion happens. On the other hand, existing bottom-up methods consider all people at the same time and capture the global knowledge of the entire image. However, they are less accurate than the top-down methods due to the scale variation. To address these problems, we propose a novel Dual-Pipeline Integrated Transformer (DPIT) by integrating top-down and bottom-up pipelines to explore the visual clues of different receptive fields and achieve their complementarity. Specifically, DPIT consists of two branches, the bottom-up branch deals with the whole image to capture the global visual information, while the top-down branch extracts the feature representation of local vision from the single-human bounding box. Then, the extracted feature representations from bottom-up and top-down branches are fed into the transformer encoder to fuse the global and local knowledge interactively. Moreover, we define the keypoint queries to explore both full-scene and single-human posture visual clues to realize the mutual complementarity of the two pipelines. To the best of our knowledge, this is one of the first works to integrate the bottom-up and top-down pipelines with transformers for human pose estimation. Extensive experiments on COCO and MPII datasets demonstrate that our DPIT achieves comparable performance to the state-of-the-art methods.

DP-Pose: Multi-Person Pose Estimation in Video Sequence Through Dynamic Programming

Based on network probabilistic graph human pose segmentation algorithm

Deep Dual Consecutive Network for Human Pose Estimation

SD-Pose: facilitating space-decoupled human pose estimation via adaptive pose perception guidance

Research on 3D Human Pose Estimation Technique Based on Multi-View Information Fusion

SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentation

DirectPose: Direct End-to-End Multi-Person Pose Estimation

Multi-Human Pose Estimation by Deep Learning-Based Sequential Approach for Human Keypoint Position and Human Body Detection

A Deconvolutional Bottom-up Deep Network for Multi-Person Pose Estimation.

Robust 3D Human Pose Estimation from Single Images or Video Sequences

3D Human Pose Estimation from Deep Multi-View 2D Pose

DPIT: Dual-Pipeline Integrated Transformer for Human Pose Estimation

Multi-Person Pose Estimation with Accurate Heatmap Regression and Greedy Association

Multi-Person Pose Estimation with LIMB Detection Heatmaps

Single-view Multi-Human Pose Estimation by Attentive Cross-Dimension Matching.

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time

FCPose: Fully Convolutional Multi-Person Pose Estimation with Dynamic Instance-Aware Convolutions

Object Pose Estimation Based on Multi-precision Vectors and Seg-Driven PnP

OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields

A Top-down Approach to Articulated Human Pose Estimation and Tracking