Abstract:The 3D human body model for virtual try-on requires not only accurate human body shape estimation but also detailed facial morphology representation. The facial shape and expression of the traditional 3D human body model are neutral with a sense of visual alienation. In addition, the traditional 3D face model lacks complete human body support with a visual sense of suspension. Thus, a new modeling method for the human body model with facial morphology is proposed in this paper. Our model has an accurate representation of human body shape and brings people a sense of self-identity with the model. In this paper, we proposed a 3D landmark supplement method for the facial region of the human body model, which is taken as the registration data. We proposed the weak-rigid local registration between the human body and face model by restraining the sparse 3D landmark position and global shape, which includes the translation rotation and scaling of the face model. We proposed the head cut and packed ring generation method based on the Bezier curve that further solves the interference between components. In the 3D landmark localization experiment, the supplemental landmark average error of the face models on the HFC dataset is approximately 0.2 mm. In the registration experiment, in the case of high precision, the convergence of the restraining landmark position is verified, and the average number of steps is 1125. In the case of real-time application, some measures are also provided to complete the registration in less than 10 s; and compared with the NR-ICP registration, our method has better performance locally and on noncorresponding structure registration. In the model evaluation experiment, the universality and application in virtual try-on are demonstrated, and our method has better performance in virtual try-on compared to SMPL-X or MTC.

Head-reference Human Contour Model

Human Contour Extraction Using Level Set

Upper Body Human Detection and Segmentation in Low Contrast Video

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

Subject-Specific Human Modeling for Human Pose Estimation

Human Gait Recognition Based on Self-Adaptive Hidden Markov Model

A novel hierarchical framework for human head-shoulder detection

A Robust Multi‐View System for High‐Fidelity Human Body Shape Reconstruction

Construction of Human Digital Twin Model Based on Multimodal Data and Its Application in Locomotion Mode Identification

Human Action Recognition Based on DMMs, HOGs and Contourlet Transform

Multi-view Human Motion Capture with an Improved Deformation Skin Model

Trajectory-Based Modeling Of Human Actions With Motion Reference Points

Exemplar-Based human contour tracking

Human 3D Motion Recognition Based on Spatial-Temporal Context of Joints

Contour Graph Based Human Tracking and Action Sequence Recognition

Marker-Less Human Body Tracking Using Locally Affine Invariant Contour Matching

A Modeling Method for the Human Body Model with Facial Morphology

A Hierarchical Model for Human Action Recognition from Body-Parts

Contour-motion Feature (CMF): A Space-Time Approach for Robust Pedestrian Detection

Combining Adaptive Hierarchical Depth Motion Maps with Skeletal Joints for Human Action Recognition

Detailed Human Shape Estimation From A Single Image By Hierarchical Mesh Deformation