Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Constraint-Based Optimized Human Skeleton Extraction from Single-Depth Camera

3D Articulated Skeleton Extraction Using a Single Consumer-Grade Depth Camera.

Human Pose Tracking Algorithm Based on Skeleton-Texture Model

Unsupervised Human Skeleton Extraction from Kinect Depth Images.

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

A 2.5D Thinning Algorithm for Human Skeleton Extraction from a Single Depth Image

A Human Skeleton Data Optimization Algorithm for Multi-Kinect

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

SkeletonPose: Exploiting Human Skeleton Constraint for 3D Human Pose Estimation

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

A 3d Human Skeletonization Algorithm For A Single Monocular Camera Based On Spatial-Temporal Discrete Shadow Integration

3D Human Body Skeleton Extraction from Consecutive Surfaces Using a Spatial–temporal Consistency Model

L-0-regularization-based Skeleton Optimization from Consecutive Point Sets of Kinetic Human Body

SkeletonFusion: Reconstruction and Tracking of Human Body in Real-Time

Parametric Human Body Reconstruction Based on Sparse Key Points.

Skeleton Cluster Tracking for robust multi-view multi-person 3D human pose estimation

A Robust Rigid Skeleton Extraction Method from Noisy Visual Hull Model

Estimating a 3D Human Skeleton from a Single RGB Image by Fusing Predicted Depths from Multiple Virtual Viewpoints

Research on human skeleton extraction

Observation-oriented silhouette-aware fast full body tracking with Kinect

Human Skeleton Tracking Using Information Weighted Consensus Filter in Distributed Camera Networks