Abstract:Estimating the 3-D human poses of multiple individuals using multiple cameras is a significant research topic within the field of vision-based measurement. Contrary to the classical outside-in camera capture system, the inside-out panoramic camera capture system can cover larger scenes with fewer cameras for 3-D human pose estimation. This advancement extends the application of 3-D human pose measurement beyond small spaces like motion capture studios. For example, this approach can be utilized for intelligent security surveillance in broad outdoor squares or capturing athletes’ movements in large-scale sports scenes. However, existing inside-out 3-D human pose estimation methods that utilize panoramic cameras encounter challenges, particularly in multiperson occlusion scenarios. Aimed at these problems, this article presents a novel inside-out multiperson 3-D human pose estimation method using just a few calibrated panoramic cameras. Specifically, we first propose a cross-view multiperson matching algorithm based on panoramic camera epipolar geometry constraint to improve human body matching robustness across viewpoints. Then, we take advantage of multiple panoramic cameras and introduce a multiview human pose clustering and fusion algorithm to improve the average recall (AR) of 3-D human pose estimation. In addition, we propose a multiview human pose nonlinear optimization algorithm to jointly optimize the weighted reprojection errors of estimated 3-D human poses, which can further improve the average precision (AP). We have conducted extensive experiments on the public Panoptic Studio dataset and self-built real and simulated datasets to demonstrate that our method can inside-out estimate 3-D human poses using multiple panoramic cameras. Compared to state-of-the-art methods, the 3-D human pose omission is greatly reduced through the complementarity of multiple cameras, and the precision of 3-D human pose estimation is largely improved by utilizing multicamera observation information.

Human Localization in a Cluttered Space Using Multiple Cameras

Human Body Recognition And Positioning With Multiple Cameras Based On "Vibration Signals" From Skin Surfaces

Human Localization Using Multi-Source Heterogeneous Data in Indoor Environments

A Robust Approach for Person Localization in Multi-camera Environment

Mean of Means: A 10-dollar Solution for Human Localization with Calibration-free and Unconstrained Camera Settings

Three-Dimensional Localization Method of Multiple Infrared Cameras Based on Subpixel

Human Motion Tracking by Multiple RGBD Cameras.

Device-free human localization using panoramic camera and indoor map

Human Localization Based on Distributed Laser Range Finders

A Robust Tracking Algorithm in Crowded Environment

Humanoid robot localization in complex indoor environments

Increasing the Efficiency of 6-DoF Visual Localization Using Multi-Modal Sensory Data

Geometric constraints of locating cameras and people

A multi-camera approach to tracking and localization of people with coexisting robots

Human Detection Using Multi-Camera And 3d Scene Knowledge

3D Activity Localization with Multiple Sensors: Poster Abstract.

Inside-Out Multiperson 3-D Pose Estimation Using the Panoramic Camera Capture System

6D Camera Relocalization in Visually Ambiguous Extreme Environments

Robust Multi-Camera 3D People Tracking with Partial Occlusion Handling

Auto Calibration of Multi-Camera System for Human Pose Estimation

Image-Based Camera Localization For Large And Outdoor Environments