Abstract:It remains challenging how to acquire a human body shape with high precision and evaluate the reconstructed models effectively, because the results can be easily affected by various factors (e.g., the performance of the capture device, the unwanted movement of the subject, and the self-occlusion of the articulated body structure). To tackle the above challenges, this research presents a passive acquisition system, which comprises 60 spatially-configured Digital Single Lens Reflex (DSLR) cameras and a carefully devised algorithmic pipeline for shape acquisition in a single shot. Different from traditional multi-view stereo solutions, the constituent cameras are synchronized and organized into 30 binocular stereo rigs to capture images from multiple views simultaneously. Each binocular stereo rig is regarded as a depth sensor. The acquisition pipeline consists of three stages. First, camera calibration is performed to estimate intrinsic and extrinsic parameters of all cameras, especially for paired binocular cameras. Second, depth inference based on stereo matching is employed to recover reliable depth information from RGB images. A novel hierarchical seed-propagation stereo matching framework is proposed, resulting in 30 dense and uniform-distributed partial point clouds. Finally, a point-based geometry processing step composed of multi-view registration and surface meshing is carried out to obtain high-quality watertight human body shapes. This research also proposes an elaborate and novel method to assess the accuracy of reconstructed non-rigid human body model based on anthropometry parameters, which solves the synchronization of the ground-truth values and the measured values. Experimental results show that the system can achieve the reconstruction accuracy within 2.5 mm in average. (C) 2020 Elsevier Ltd. All rights reserved.

Combining template matching and model fitting for human body segmentation and tracking with applications to sports training

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Human motion tracking based on shape analysis

A Robust and Fast Model-Based Athlete Contour Tracking in Diving Videos

Spatiotemporal Strategies for Joint Segmentation and Motion Tracking from Cardiac Image Sequences

Reconstruction of 3D Human Motion Using Multiple View L1 Trackers

Body Detection and Tracking with Hierarchical Scheme in Dynamic Scenes

Upper Body Human Detection and Segmentation in Low Contrast Video

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

RGB-D Camera based Human Limb Movement Recognition and Tracking in Supine Positions.

Adaptive Particle Filter With Body Part Segmentation For Full Body Tracking

Tracking Athletes in Diving Videos Based on Pose Learning

Marker-Less Human Body Tracking Using Locally Affine Invariant Contour Matching

Automatic Video-based Analysis of Athlete Action

Exploiting Pair-Wise Constraints Between Parts for Human Tracking

Learning a Tracking and Estimation Integrated Graphical Model for Human Pose Tracking.

Iterative Scale-Up ExpansionIoU and Deep Features Association for Multi-Object Tracking in Sports

Automatic tracking of moving human body based on remote sensing spatial information

A Learning-Based Tracking for Diving Motions

Detection and tracking of human track and field motion targets based on deep learning

Single-Stage Pose Estimation and Joint Angle Extraction Method for Moving Human Body