Abstract:Monocular Human Pose Estimation (HPE) aims at determining the 3D positions of human joints from a single 2D image captured by a camera. However, a single 2D point in the image may correspond to multiple points in 3D space. Typically, the uniqueness of the 2D-3D relationship is approximated using an orthographic or weak-perspective camera model. In this study, instead of relying on approximations, we advocate for utilizing the full perspective camera model. This involves estimating camera parameters and establishing a precise, unambiguous 2D-3D relationship. To do so, we introduce the EPOCH framework, comprising two main components: the pose lifter network (LiftNet) and the pose regressor network (RegNet). LiftNet utilizes the full perspective camera model to precisely estimate the 3D pose in an unsupervised manner. It takes a 2D pose and camera parameters as inputs and produces the corresponding 3D pose estimation. These inputs are obtained from RegNet, which starts from a single image and provides estimates for the 2D pose and camera parameters. RegNet utilizes only 2D pose data as weak supervision. Internally, RegNet predicts a 3D pose, which is then projected to 2D using the estimated camera parameters. This process enables RegNet to establish the unambiguous 2D-3D relationship. Our experiments show that modeling the lifting as an unsupervised task with a camera in-the-loop results in better generalization to unseen data. We obtain state-of-the-art results for the 3D HPE on the Human3.6M and MPI-INF-3DHP datasets. Our code is available at: [Github link upon acceptance, see supplementary materials].

A Review on Human Pose Estimation

A Systematic Review of the Application of Camera-Based Human Pose Estimation in the Field of Sport and Physical Exercise

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

Vision-Based Human Pose Estimation via Deep Learning: A Survey

Bottom-up approaches for multi-person pose estimation and it's applications: A brief review

Review of Deep Learning-Based Human Pose Estimation

Deep Learning-Based Human Pose Estimation: A Survey

Comparative Analysis of Skeleton-Based Human Pose Estimation

A Survey on Deep Learning-Based 2D Human Pose Estimation Models

Ultimate pose estimation: A comparative study

3D Human Pose Estimation Based on Wearable IMUs and Multiple Camera Views

Real-time Pose Estimation for Mobile Devices: A Review

Human Modelling and Pose Estimation Overview

A Survey of Human Pose Estimation from Single Images

Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Models

Lighter Stacked Hourglass Human Pose Estimation

Markerless human pose estimation for biomedical applications: a survey

Deep 3D human pose estimation: A review

EPOCH: Jointly Estimating the 3D Pose of Cameras and Humans

Efficient Monocular Human Pose Estimation Based on Deep Learning Methods: A Survey