Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Generation of human depth images with body part labels for complex human pose recognition

Real-time human pose recognition in parts from single depth images

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

Single Image Depth Map Estimation for Improving Posture Recognition

Human Part Segmentation in Depth Images with Annotated Part Positions

Image-Based Synthesis for Deep 3D Human Pose Estimation

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

UltraPose: Synthesizing Dense Pose with 1 Billion Points by Human-body Decoupling 3D Model

Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images

Face-from-Depth for Head Pose Estimation on Depth Images

Monocular 3D Human Pose Estimation by Predicting Depth on Joints

A Deep Structure for Human Pose Estimation

AnatPose: Bidirectionally learning anatomy-aware heatmaps for human pose estimation

MoCap-guided Data Augmentation for 3D Pose Estimation in the Wild

Generalizing Monocular 3d Human Pose Estimation In The Wild

3D Human Pose and Shape Estimation with Dense Correspondence from a Single Depth Image

Deep Learning-Based Human Pose Estimation: A Survey

Accurate Estimation of Body Height From a Single Depth Image via a Four-Stage Developing Network

Detailed Human Shape Estimation From A Single Image By Hierarchical Mesh Deformation

Bodies at Rest: 3D Human Pose and Shape Estimation from a Pressure Image using Synthetic Data