Abstract:Most of the existing 3D human pose estimation approaches mainly focus on predicting 3D positional relationships between the root joint and other human joints (local motion) instead of the overall trajectory of the human body (global motion). Despite the great progress achieved by these approaches, they are not robust to global motion, and lack the ability to accurately predict local motion with a small movement range. To alleviate these two problems, we propose a relative information encoding method that yields positional and temporal enhanced representations. Firstly, we encode positional information by utilizing relative coordinates of 2D poses to enhance the consistency between the input and output distribution. The same posture with different absolute 2D positions can be mapped to a common representation. It is beneficial to resist the interference of global motion on the prediction results. Second, we encode temporal information by establishing the connection between the current pose and other poses of the same person within a period of time. More attention will be paid to the movement changes before and after the current pose, resulting in better prediction performance on local motion with a small movement range. The ablation studies validate the effectiveness of the proposed relative information encoding method. Besides, we introduce a multi-stage optimization method to the whole framework to further exploit the positional and temporal enhanced representations. Our method outperforms state-of-the-art methods on two public datasets. Code is available at https://github.com/paTRICK-swk/Pose3D-RIE.

Globally Optimal Consensus Maximization for Relative Pose Estimation With Known Gravity Direction

Globally Optimal Consensus Maximization for Robust Visual Inertial Localization in Point and Line Map.

Globally Optimal Relative Pose Estimation with Gravity Prior

Absolute Pose Estimation with a Known Direction by Motion Decoupling

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

Direct Alignment with Generalized Correspondences: A Unified Framework for Structure-Based Visual Pose Estimation.

Globally-Optimal Inlier Maximization for Relative Pose Estimation Under Planar Motion

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

Globally Optimal Relative Pose Estimation for Multi-Camera Systems with Known Gravity Direction

Globally Optimal Solution to the Generalized Relative Pose Estimation Problem Using Affine Correspondences

Globally Optimal Relative Pose Estimation Using Affine Correspondences with Known Vertical Direction

Globally Optimal Relative Pose and Scale Estimation from Only Image Correspondences with Known Vertical Direction

Linear Relative Pose Estimation Founded on Pose-only Imaging Geometry

Relative Pose for Nonrigid Multi-Perspective Cameras: The Static Case

Robust and Efficient Relative Pose with a Multi-Camera System for Autonomous Driving in Highly Dynamic Environments.

Homography-Based Minimal-Case Relative Pose Estimation with Known Gravity Direction

A ROBUST METHOD FOR STEREO VISUAL ODOMETRY BASED ON MULTIPLE EUCLIDEAN DISTANCE CONSTRAINT AND RANSAC ALGORITHM

Robust and Efficient Estimation of Absolute Camera Pose for Monocular Visual Odometry.

Homography-based Camera Pose Estimation with Known Gravity Direction for UAV Navigation

Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimation

A General Optimization-based Framework for Global Pose Estimation with Multiple Sensors.