Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

KBody: Towards general, robust, and aligned monocular whole-body estimation

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

The Best of Both Worlds: Combining Model-based and Nonparametric Approaches for 3D Human Body Estimation

Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimation

3D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimation

Parametric Human Body Reconstruction Based on Sparse Key Points.

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimation

HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recovery

Full-body Motion Capture for Multiple Closely Interacting Persons.

Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video

FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integration

Joint Multi-Person Body Detection and Orientation Estimation via One Unified Embedding

Leveraging Two Kinect Sensors for Accurate Full-Body Motion Capture

Monocular Real-time Full Body Capture with Inter-part Correlations

Coupling Top-down and Bottom-up Methods for 3D Human Pose and Shape Estimation from Monocular Image Sequences

AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time

3d Body Pose And Shape Estimation From Multi-View Images With Limb Geometric Constraint

Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstruction

Multi-Person 3d Pose Estimation From Monocular Image Sequences

SimpleEgo: Predicting Probabilistic Body Pose from Egocentric Cameras