Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Digitize Your Body and Action in 3-D at Over 10 FPS: Real Time Dense Voxel Reconstruction and Marker-less Motion Tracking via GPU Acceleration.

A Multi-camera Network System for Markerless 3D Human Body Voxel Reconstruction

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

SkeletonFusion: Reconstruction and Tracking of Human Body in Real-Time

An accelerated human motion tracking system based on voxel reconstruction under complex environments

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

A Real-Time and Globally Consistent Meshing Reconstruction Without GPU.

3D Real Human Reconstruction Via Multiple Low-Cost Depth Cameras.

Ihuman3d: Intelligent Human Body 3D Reconstruction Using a Single Flying Camera.

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

An Integrated Platform for Live 3D Human Reconstruction and Motion Capturing

Accurate realtime full-body motion capture using a single depth camera

UnstructuredFusion: Realtime 4D Geometry and Texture Reconstruction Using Commercial RGBD Cameras.

Human101: Training 100+FPS Human Gaussians in 100s from 1 View

ReTiCaM: Real-time Human Performance Capture from Monocular Video

Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection.

LiveCap: Real-time Human Performance Capture from Monocular Video

Monocular Real-Time Human Geometry Reconstruction

PoseFusion2: Simultaneous Background Reconstruction and Human Shape Recovery in Real-time

Skeleton Driven Non-rigid Motion Tracking and 3D Reconstruction