Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

A 3D reconstruction algorithm of multiple objects

MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion

In-Hand 3D Object Reconstruction from a Monocular RGB Video

Visual Odometry Based 3D-Reconstruction

Motion Imitation of a Humanoid Robot Via Pose Estimation

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

Scene Reconstruction with Functional Objects for Robot Autonomy

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Deep Single-View 3D Object Reconstruction with Visual Hull Embedding

An Interactive Control Approach to 3D Shape Reconstruction

Kinematics-based 3D Human-Object Interaction Reconstruction from Single View

Ihuman3d: Intelligent Human Body 3D Reconstruction Using a Single Flying Camera.

3D Real Human Reconstruction Via Multiple Low-Cost Depth Cameras.

A Visual Hull Free Algorithm for Fast and Robust Multi-View Stereo.

Stereo Hand-Object Reconstruction for Human-to-Robot Handover

You Only Scan Once: A Dynamic Scene Reconstruction Pipeline for 6-DoF Robotic Grasping of Novel Objects

A New Algorithm for 3d Facial Model Reconstruction and Its Application in Vr

Long-Range 3D Reconstruction Based on Flexible Configuration Stereo Vision Using Multiple Aerial Robots

A Two-Stage Monocular Vision Detection Method for 6D Pose Estimation in Multi-Heterogeneous Robot Systems

3D Reconstruction From Traditional Methods to Deep Learning