Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Accurate Estimation of Human Body Orientation from Rgb-D Sensors

Healthy Human Sitting Posture Estimation in RGB-D Scenes Using Object Context

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Fast and Efficient Integration of Human Upper-Body Detection and Orientation Estimation in RGB-D Video

Human Body Orientation Estimation using Convolutional Neural Network

RGB-D Camera based Human Limb Movement Recognition and Tracking in Supine Positions.

An RGB-D Based Approach for Human Pose Estimation

Towards Fine-Grained HBOE with Rendered Orientation Set and Laplace Smoothing

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

Real-time RGBD-based Extended Body Pose Estimation

Body and Head Orientation Estimation from Low-Resolution Point Clouds in Surveillance Settings

A Survey on Monocular 3D Human Pose Estimation

Detecting and tracking people in real time with RGB-D camera

3D Body Shapes Estimation from Dressed-Human Silhouettes.

Relative Pose Estimation for RGB-D Human Input Scans Via Implicit Function Reconstruction

6D pose estimation of 3D objects in scenes with mutual similarities and occlusions

Orientation Keypoints for 6D Human Pose Estimation

Human Orientation Estimation under Partial Observation

Robust Estimation of 3D Human Poses from a Single Image