Abstract:Estimating the 3-D human poses of multiple individuals using multiple cameras is a significant research topic within the field of vision-based measurement. Contrary to the classical outside-in camera capture system, the inside-out panoramic camera capture system can cover larger scenes with fewer cameras for 3-D human pose estimation. This advancement extends the application of 3-D human pose measurement beyond small spaces like motion capture studios. For example, this approach can be utilized for intelligent security surveillance in broad outdoor squares or capturing athletes’ movements in large-scale sports scenes. However, existing inside-out 3-D human pose estimation methods that utilize panoramic cameras encounter challenges, particularly in multiperson occlusion scenarios. Aimed at these problems, this article presents a novel inside-out multiperson 3-D human pose estimation method using just a few calibrated panoramic cameras. Specifically, we first propose a cross-view multiperson matching algorithm based on panoramic camera epipolar geometry constraint to improve human body matching robustness across viewpoints. Then, we take advantage of multiple panoramic cameras and introduce a multiview human pose clustering and fusion algorithm to improve the average recall (AR) of 3-D human pose estimation. In addition, we propose a multiview human pose nonlinear optimization algorithm to jointly optimize the weighted reprojection errors of estimated 3-D human poses, which can further improve the average precision (AP). We have conducted extensive experiments on the public Panoptic Studio dataset and self-built real and simulated datasets to demonstrate that our method can inside-out estimate 3-D human poses using multiple panoramic cameras. Compared to state-of-the-art methods, the 3-D human pose omission is greatly reduced through the complementarity of multiple cameras, and the precision of 3-D human pose estimation is largely improved by utilizing multicamera observation information.

Multi-Agent Deep Reinforcement Learning for Online 3D Human Poses Estimation

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Proactive Multi-Camera Collaboration For 3D Human Pose Estimation

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

Multi-person 3D pose estimation from unlabelled data

Unsupervised Domain Adaptation for 3D Human Pose Estimation

3D Human Pose Estimation from Deep Multi-View 2D Pose

QuickPose: Real-time Multi-view Multi-person Pose Estimation in Crowded Scenes

3d Pose Detection Of Closely Interactive Humans Using Multi-View Cameras

Dual-view 3D Human Pose Estimation Without Camera Parameters for Action Recognition

Active 6D Multi-Object Pose Estimation in Cluttered Scenarios with Deep Reinforcement Learning

Embodied Scene-aware Human Pose Estimation

Inside-Out Multiperson 3-D Pose Estimation Using the Panoramic Camera Capture System

LiCamPose: Combining Multi-View LiDAR and RGB Cameras for Robust Single-frame 3D Human Pose Estimation

Dual networks based 3D Multi-Person Pose Estimation from Monocular Video

Self-learning Canonical Space for Multi-view 3D Human Pose Estimation

AvatarPose: Avatar-guided 3D Pose Estimation of Close Human Interaction from Sparse Multi-view Videos

SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation

Active Human Pose Estimation via an Autonomous UAV Agent