Abstract:Monocular 3D human pose estimation has made progress in recent years. Most of the methods focus on single persons, which estimate the poses in the person-centric coordinates, i.e., the coordinates based on the center of the target person. Hence, these methods are inapplicable for multi-person 3D pose estimation, where the absolute coordinates (e.g., the camera coordinates) are required. Moreover, multi-person pose estimation is more challenging than single pose estimation, due to inter-person occlusion and close human interactions. Existing top-down multi-person methods rely on human detection (i.e., top-down approach), and thus suffer from the detection errors and cannot produce reliable pose estimation in multi-person scenes. Meanwhile, existing bottom-up methods that do not use human detection are not affected by detection errors, but since they process all persons in a scene at once, they are prone to errors, particularly for persons in small scales. To address all these challenges, we propose the integration of top-down and bottom-up approaches to exploit their strengths. Our top-down network estimates human joints from all persons instead of one in an image patch, making it robust to possible erroneous bounding boxes. Our bottom-up network incorporates human-detection based normalized heatmaps, allowing the network to be more robust in handling scale variations. Finally, the estimated 3D poses from the top-down and bottom-up networks are fed into our integration network for final 3D poses. To address the common gaps between training and testing data, we do optimization during the test time, by refining the estimated 3D human poses using high-order temporal constraint, re-projection loss, and bone length regularizations. Our evaluations demonstrate the effectiveness of the proposed method. Code and models are available: <a class="link-external link-https" href="https://github.com/3dpose/3D-Multi-Person-Pose" rel="external noopener nofollow">this https URL</a>.

A Two-Stage Monocular Vision Detection Method for 6D Pose Estimation in Multi-Heterogeneous Robot Systems

MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

Fast Recognition and Precise Localization of Humanoid Soccer Robot Vision System

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Research on Model-Free 6D Object Pose Estimation Based on Vision 3D Matching.

Monocular Vision Based 6D Object Localization for Service Robot's Intelligent Grasping

Fusing monocular vision and laser range data for human detection and tracking via multi-robot collaboration

6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

Dual networks based 3D Multi-Person Pose Estimation from Monocular Video

On the Evaluation of Diverse Vision Systems towards Detecting Human Pose in Collaborative Robot Applications

Study and Application of Monocular Vision-Based Assembly Robot

Multi-View Keypoints for Reliable 6D Object Pose Estimation

Object Detection and Pose Estimation from RGB and Depth Data for Real-time, Adaptive Robotic Grasping

Single-Camera Multi-View 6DoF pose estimation for robotic grasping

Robust Pose Estimation via Hybrid Point and Twin Line Reprojection for RGB-D Vision Navigation

Distributed and Collaborative Monocular Simultaneous Localization and Mapping for Multi-Robot Systems in Large-Scale Environments

Research on 6DOF Gripping Position Measurement Strategy of Robot Based on Monocular Vision

A Positioning System Based on Monocular Vision for Industrial Robots

A Manufacturing-Oriented Intelligent Vision System Based on Deep Neural Network for Object Recognition and 6D Pose Estimation

Object 6DoF Pose Estimation for Power Grid Manipulating Robots.