Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Multi-View Body Structure-Constrainted Human Detection Method

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

Human Detection Method Based on Multi-Part Detector and Multi-Instance Learning

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

3d Pose Detection Of Closely Interactive Humans Using Multi-View Cameras

Multiple Human Association between Top and Horizontal Views by Matching Subjects' Spatial Distributions

A Robust Multi‐View System for High‐Fidelity Human Body Shape Reconstruction

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

Shape and Pose Estimation for Closely Interacting Persons Using Multi-view Images.

Multi-view Moving Human Detection and Correspondence Based on Object Occupancy Random Field

Human Pose Estimation Based on Parallel Atrous Convolution and Body Structure Constraints

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

Novel Framework for Multi-view Object Detection through Combining Multiple Classifiers

Multiview Detection with Cardboard Human Modeling

Multiple Human Tracking Based on Multi-view Upper-Body Detection and Discriminative Learning

Human Multi-View Synthesis from a Single-View Model:Transferred Body and Face Representations

Part-Aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking

MUC: Mixture of Uncalibrated Cameras for Robust 3D Human Body Reconstruction

Exploiting Pair-Wise Constraints Between Parts for Human Tracking

Center point to pose: Multiple views 3D human pose estimation for multi-person

Part template: 3D representation for multiview human pose estimation