Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Human Pose Estimation Algorithm Based on Segmentations of Human Head and Shoulder in Video Sequences

Based on network probabilistic graph human pose segmentation algorithm

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Global Pose Estimation Iterative Algorithm for Multi-camera from Point and Line Correspondences

Real-Time Human Segmentation Using Pose Skeleton Map

Robust 3D Human Pose Estimation from Single Images or Video Sequences

Affine Correspondence Based Head Pose Estimation For A Sequence Of Images By Using A 3d Model

Upper Body Human Detection and Segmentation in Low Contrast Video

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Pose Estimation for Swimmers in Video Surveillance

A 3D 2-subiteration thinning algorithm for human pose estimation

Human Pose Estimation in Static Images Based on Region Segmentation and Monte Carlo Sampling

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

Face Pose Estimation Based on 3D Models and Affine Correspondences

3D Human pose estimation from video via multi-scale multi-level spatial temporal features

Locating human hands for real-time pose estimation from monocular video

Single-Stage Pose Estimation and Joint Angle Extraction Method for Moving Human Body

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

Motion Capture Research: 3D Human Pose Recovery Based on RGB Video Sequences

Multiview human pose estimation with unconstrained motions

Human Posture Tracking in a Multi-Camera Environment