Abstract:In the domain of 3D Human Pose Estimation, which finds widespread daily applications, the requirement for convenient acquisition equipment continues to grow. To satisfy this demand, we set our sights on a short-baseline binocular setting that offers both portability and a geometric measurement property that radically mitigates depth ambiguity. However, as the binocular baseline shortens, two serious challenges emerge: first, the robustness of 3D reconstruction against 2D errors deteriorates; and second, occlusion reoccurs due to the limited visual differences between two views. To address the first challenge, we propose the Stereo Co-Keypoints Estimation module to improve the view consistency of 2D keypoints and enhance the 3D robustness. In this module, the disparity is utilized to represent the correspondence of binocular 2D points and the Stereo Volume Feature is introduced to contain binocular features across different disparities. Through the regression of SVF, two-view 2D keypoints are simultaneously estimated in a collaborative way which restricts their view consistency. Furthermore, to deal with occlusions, a Pre-trained Pose Transformer module is introduced. Through this module, 3D poses are refined by perceiving pose coherence, a representation of joint correlations. This perception is injected by the Pose Transformer network and learned through a pre-training task that recovers iterative masked joints. Comprehensive experiments carried out on H36M and MHAD datasets, complemented by visualizations, validate the effectiveness of our approach in the short-baseline binocular 3D Human Pose Estimation and occlusion handling.

Robust Binocular Pose Estimation Based On Pigeon-Inspired Optimization

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Robust Orthogonal Iteration Algorithm for Single Camera Pose Estimation

A Pose Estimation and Optimization Method for Mobile Manipulator’s End-effectors Based on Stereo Vision and ICoP Algorithm*

Robust and Efficient Estimation of Absolute Camera Pose for Monocular Visual Odometry.

RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling

A Robust and Fast Method to the Perspective-n-Point Problem for Camera Pose Estimation

A Robust Pose Estimation Method for Nearly Coplanar Points

A New On-Board UAV Pose Estimation System Based on Monocular Camera

Multi-View Keypoints for Reliable 6D Object Pose Estimation

Monocular Pose Estimation Algorithm Based on the Bundle Adjustment Method

An Optimization Based Framework for Human Pose Estimation

A Hybrid Genetic Algorithm For Relative Pose Estimation Captured By Hand-Held Camera

EPOSIT: An Absolute Pose Estimation Method for Pinhole and Fish-Eye Cameras

Robust Pose Estimation Based on Maximum Correntropy Criterion.

A Pose Estimation Method for Indoor UAV Based on Binocular Vision

Binocular Dance Pose Recognition and Body Orientation Estimation via Multilinear Analysis

Monocular Vision-Based Iterative Pose Estimation Algorithm from Corresponding Feature Points

Binocular Pose Estimation for UAV Autonomous Aerial Refueling via Brain Storm Optimization

Joint Optimization of the 3D Model and 6D Pose for Monocular Pose Estimation