Abstract:This research proposes a novel adjustable algorithm for reconstructing 3D body shapes from front and side silhouettes. Most recent silhouette-based approaches use a deep neural network trained by silhouettes and key points to estimate the shape parameters but cannot accurately fit the model to the body contours and consequently are struggling to cover detailed body geometry, especially in the torso. In addition, in most of these cases, body parts have the same accuracy priority, making the optimization harder and avoiding reaching the optimum possible result in essential body parts, like the torso, which is visually important in most applications, such as virtual garment fitting. In the proposed method, the expected accuracy for each body part can be adjusted based on the purpose by assigning coefficients for the distance of each body part between the projected 3D body and 2D silhouettes. To measure this distance, the correspondent body parts are first recognized using body segmentation in both views. Individual body parts are aligned by 2D rigid registration and matched using pairwise matching. The objective function tries to minimize the distance cost for the individual body parts in both views based on distances and coefficients by optimizing the statistical model parameters. The slight variation in the degree of arms and limbs is also handled by matching the pose. The proposed method was evaluated with images of synthetic and real body meshes. The result shows that the algorithm accurately reconstructs visually important body parts with high coefficients.

Inter-Point Procrustes: Identifying Regional and Large Differences in 3D Anatomical Shapes

Object Localization Using Non-Euclidean Metrics

Procrustes registration of two-dimensional statistical shape models without correspondences

Distances and Algorithms to Compare Sets of Shapes for Automated Biological Morphometrics

Capturing the multiscale anatomical shape variability with polyaffine transformation trees

Feature matching with Procrustes alignment and graph editing

A Novel 3D/2D Correspondence Building Method for Anatomy-Based Registration

High-Accuracy Relative Pose Measurement of Noncooperative Objects Based on Double-Constrained Intersurface Mutual Projections

Non-rigid 3D Shape Registration using an Adaptive Template

An Inter-Landmark Approach to 4-D Shape Extraction and Interpretation: Application to Myocardial Motion Assessment in Mri

Statistical analysis of locally parameterized shapes

Articulated pose identification with sparse point features

Shape analysis via inconsistent surface registration

Efficient Similarity Point Set Registration by Transformation Decomposition

A New Algorithm for Non-Rigid Shape Matching with Anisotropic-Scaling Transformation Parameters

Shape Augmented Regression For 3d Face Alignment

Use of A Dense Surface Point Distribution Model in A Three-Stage Anatomical Shape Reconstruction from Sparse Information for Computer Assisted Orthopaedic Surgery: A Preliminary Study

Adjustable method based on body parts for improving the accuracy of 3D reconstruction in visually important body parts from silhouettes

Personalized 3D Human Pose and Shape Refinement

Orientation estimation of anatomical structures in medical images for object recognition

Robust Registration and Geometry Estimation from Unstructured Facial Scans