Abstract:Estimating the 3-D human poses of multiple individuals using multiple cameras is a significant research topic within the field of vision-based measurement. Contrary to the classical outside-in camera capture system, the inside-out panoramic camera capture system can cover larger scenes with fewer cameras for 3-D human pose estimation. This advancement extends the application of 3-D human pose measurement beyond small spaces like motion capture studios. For example, this approach can be utilized for intelligent security surveillance in broad outdoor squares or capturing athletes’ movements in large-scale sports scenes. However, existing inside-out 3-D human pose estimation methods that utilize panoramic cameras encounter challenges, particularly in multiperson occlusion scenarios. Aimed at these problems, this article presents a novel inside-out multiperson 3-D human pose estimation method using just a few calibrated panoramic cameras. Specifically, we first propose a cross-view multiperson matching algorithm based on panoramic camera epipolar geometry constraint to improve human body matching robustness across viewpoints. Then, we take advantage of multiple panoramic cameras and introduce a multiview human pose clustering and fusion algorithm to improve the average recall (AR) of 3-D human pose estimation. In addition, we propose a multiview human pose nonlinear optimization algorithm to jointly optimize the weighted reprojection errors of estimated 3-D human poses, which can further improve the average precision (AP). We have conducted extensive experiments on the public Panoptic Studio dataset and self-built real and simulated datasets to demonstrate that our method can inside-out estimate 3-D human poses using multiple panoramic cameras. Compared to state-of-the-art methods, the 3-D human pose omission is greatly reduced through the complementarity of multiple cameras, and the precision of 3-D human pose estimation is largely improved by utilizing multicamera observation information.

Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Lifting

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

UWB-Radar-Based 3D Human Pose Estimation Using Micro-Range/Micro-Doppler Images

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

Multi-person 3D pose estimation from unlabelled data

Real-Time Through-Wall Multiperson 3-D Pose Estimation Based on MIMO Radar

Multi-Person 3d Pose Estimation From Monocular Image Sequences

Indoor 3D Human Pose Estimation Using Single Millimeter-wave Radar and Conditional Generative Adversarial Network

Inside-Out Multiperson 3-D Pose Estimation Using the Panoramic Camera Capture System

Towards Robust and Smooth 3D Multi-Person Pose Estimation from Monocular Videos in the Wild

OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields

Part-Aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking

Multi-View Person Matching and 3D Pose Estimation with Arbitrary Uncalibrated Camera Networks

Mutual Adaptive Reasoning for Monocular 3D Multi-Person Pose Estimation

Three-Dimensional Human Pose Estimation from Micro-Doppler Signature Based on SISO UWB Radar

Skeleton Cluster Tracking for robust multi-view multi-person 3D human pose estimation

Dual networks based 3D Multi-Person Pose Estimation from Monocular Video

A Simple yet Effective 2D-3D Lifting Method for Monocular 3D Human Pose Estimation.

Cross-View Tracking for Multi-Human 3D Pose Estimation at over 100 FPS