Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Human Joints Estimation System of Rescue Robot with Occlusion

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Motion Imitation of a Humanoid Robot Via Pose Estimation

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

Joint Relation Based Human Pose Estimation

Research on 3D Human Pose Estimation Technique Based on Multi-View Information Fusion

Occluded Human Pose Estimation based on Limb Joint Augmentation

Visual Perception Method Based on Human Pose Estimation for Humanoid Robot Imitating Human Motions.

Reconstructing Complete Human Bodies Using Limited Scans Obtained Via Viewpoint Auto-Changing Oriented Toward Rescue Operations.

Human Pose Detection for Robotic-Assisted and Rehabilitation Environments

3D Joints Estimation of the Human Body in Single-Frame Point Cloud

Multimodal Active Measurement for Human Mesh Recovery in Close Proximity

3d Pose Estimation Of Robot Arm With Rgb Images Based On Deep Learning

3D Human Pose Estimation Based on Multi View Information Fusion

Localization of Human 3D Joints Based on Binocular Vision

Multi-view Pose Fusion for Occlusion-Aware 3D Human Pose Estimation

Robust Model-Based 3D Torso Pose Estimation in RGB-D Sequences

Reconstructing Detailed Human Body Using a Viewpoint Auto-Changing RGB-D Sensor for Rescue Operation

Occlusion-Robust Multi-Sensory Posture Estimation in Physical Human-Robot Interaction

Joint Data Augmentation and Attention Mechanism for Occluded Human Pose Estimation