Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Personalized hand modeling based on stereo vision and RBF interpolation

Personalized Hand Modeling from Multiple Postures with Multi‐View Color Images

A synthesis method for personalized 3D face reconstruction

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

Data-Driven 3-D Human Body Customization with a Mobile Device

Realistic Virtual Hand Modeling with Applications for Virtual Grasping

Dual Quaternion Based Virtual Hand Interaction Modeling

In-Hand 3D Object Reconstruction from a Monocular RGB Video

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

3D Articulated Hand Tracking Based on Behavioral Model

Personal Virtual Human Modeling from Images

RealisticHands: A Hybrid Model for 3D Hand Reconstruction

Three-dimensional Animated Face Modeling from Stereo Video

3D Hand Pose Tracking and Estimation Using Stereo Matching.

High-resolution Real-Time 360° 3D Model Reconstruction of a Handheld Object with Fringe Projection Profilometry.

Stereo Hand-Object Reconstruction for Human-to-Robot Handover

Personalized facial animation based on 3d model fitting from two orthogonal face images

Virtual 3D Sculpturing with a Parametric Hand Surface

Deformation Representation Based Convolutional Mesh Autoencoder for 3D Hand Generation

HARP: Personalized Hand Reconstruction from a Monocular RGB Video

The Design and Implementation of 3d Hand-Based Human-Computer Interaction Platform