Abstract:The 3D human body model for virtual try-on requires not only accurate human body shape estimation but also detailed facial morphology representation. The facial shape and expression of the traditional 3D human body model are neutral with a sense of visual alienation. In addition, the traditional 3D face model lacks complete human body support with a visual sense of suspension. Thus, a new modeling method for the human body model with facial morphology is proposed in this paper. Our model has an accurate representation of human body shape and brings people a sense of self-identity with the model. In this paper, we proposed a 3D landmark supplement method for the facial region of the human body model, which is taken as the registration data. We proposed the weak-rigid local registration between the human body and face model by restraining the sparse 3D landmark position and global shape, which includes the translation rotation and scaling of the face model. We proposed the head cut and packed ring generation method based on the Bezier curve that further solves the interference between components. In the 3D landmark localization experiment, the supplemental landmark average error of the face models on the HFC dataset is approximately 0.2 mm. In the registration experiment, in the case of high precision, the convergence of the restraining landmark position is verified, and the average number of steps is 1125. In the case of real-time application, some measures are also provided to complete the registration in less than 10 s; and compared with the NR-ICP registration, our method has better performance locally and on noncorresponding structure registration. In the model evaluation experiment, the universality and application in virtual try-on are demonstrated, and our method has better performance in virtual try-on compared to SMPL-X or MTC.

Automatic Location and Semantic Labeling of Landmarks on 3D Human Body Models

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

3D Human Landmark Detection and Segmentation with Semantic Knowledge

Symmetry-Aware Semantic Segmentation of a 3D Human Body Model

Symmetry-aware Kinematic Skeleton Generation of a 3D Human Body Model.

Automatic Detection of Anatomical Landmarks on Geometric Mesh Data Using Deep Semantic Segmentation

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

A Modeling Method for the Human Body Model with Facial Morphology

Automatic landmark annotation and dense correspondence registration for 3D human facial images

A 3D Statistical Facial Feature Model and Its Application on Locating Facial Landmarks

Joint Detection and Localization of Multiple Anatomical Landmarks Through Learning.

Automatic landmark detection for high resolution non-rigid 3D faces based on geometric information

Feature Fusion Based Constrained Local Model for Three-Dimensional Facial Landmark Localization

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

Learning-based local-to-global landmark annotation for automatic 3D cephalometry

Self-supervised Landmark Learning with Deformation Reconstruction and Cross-subject Consistency Objectives

Semi-supervised Anatomical Landmark Detection via Shape-regulated Self-training

Anthropometric Landmarks Extraction and Dimensions Measurement Based on ResNet.

A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model

Automatic Measurement of Scanned Human Body in Fixed Posture

An Automatic Landmark Localization Method for 2D and 3D Face.