Abstract:Estimating the 3-D human poses of multiple individuals using multiple cameras is a significant research topic within the field of vision-based measurement. Contrary to the classical outside-in camera capture system, the inside-out panoramic camera capture system can cover larger scenes with fewer cameras for 3-D human pose estimation. This advancement extends the application of 3-D human pose measurement beyond small spaces like motion capture studios. For example, this approach can be utilized for intelligent security surveillance in broad outdoor squares or capturing athletes’ movements in large-scale sports scenes. However, existing inside-out 3-D human pose estimation methods that utilize panoramic cameras encounter challenges, particularly in multiperson occlusion scenarios. Aimed at these problems, this article presents a novel inside-out multiperson 3-D human pose estimation method using just a few calibrated panoramic cameras. Specifically, we first propose a cross-view multiperson matching algorithm based on panoramic camera epipolar geometry constraint to improve human body matching robustness across viewpoints. Then, we take advantage of multiple panoramic cameras and introduce a multiview human pose clustering and fusion algorithm to improve the average recall (AR) of 3-D human pose estimation. In addition, we propose a multiview human pose nonlinear optimization algorithm to jointly optimize the weighted reprojection errors of estimated 3-D human poses, which can further improve the average precision (AP). We have conducted extensive experiments on the public Panoptic Studio dataset and self-built real and simulated datasets to demonstrate that our method can inside-out estimate 3-D human poses using multiple panoramic cameras. Compared to state-of-the-art methods, the 3-D human pose omission is greatly reduced through the complementarity of multiple cameras, and the precision of 3-D human pose estimation is largely improved by utilizing multicamera observation information.

Pose and Position Estimations of Regular Shapes in Monocular Images

Developing Rigid Constraint for the Estimation of Pose and Structure from a Single Image

Stereo Camera Motion Estimation Based on Euclidean Reconstruction

Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

3D Information Acquisition from Rectangles and Circles in Single Images

A New Method of Camera Pose Estimation Using 2D-3D Corner Correspondence

Robust Monocular 3D Car Shape Estimation from 2D Landmarks.

Pose estimation of 3D rigid object based on tentative point correspondence

A Survey on Monocular 3D Human Pose Estimation

Another Way Of Looking At Monocular Circle Pose Estimation

Perspective-1-Ellipsoid: Formulation, Analysis and Solutions of the Camera Pose Estimation Problem from One Ellipse-Ellipsoid Correspondence

Estimation of Camera Pose Using 2D to 3D Corner Correspondence

Camera Pose Estimation Based On Angle Constraints

Face Pose Estimation Based on 3D Models and Affine Correspondences

Contour-based Iterative Pose Estimation of 3D Rigid Object

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

Robust Estimation of 3D Human Poses from a Single Image

CPS++: Improving Class-level 6D Pose and Shape Estimation From Monocular Images With Self-Supervised Learning

Monocular Pose Estimation Algorithm Based on the Bundle Adjustment Method

Rectangular-structure-based pose estimation method for non-cooperative rendezvous

Inside-Out Multiperson 3-D Pose Estimation Using the Panoramic Camera Capture System