Abstract:The 3D human body model for virtual try-on requires not only accurate human body shape estimation but also detailed facial morphology representation. The facial shape and expression of the traditional 3D human body model are neutral with a sense of visual alienation. In addition, the traditional 3D face model lacks complete human body support with a visual sense of suspension. Thus, a new modeling method for the human body model with facial morphology is proposed in this paper. Our model has an accurate representation of human body shape and brings people a sense of self-identity with the model. In this paper, we proposed a 3D landmark supplement method for the facial region of the human body model, which is taken as the registration data. We proposed the weak-rigid local registration between the human body and face model by restraining the sparse 3D landmark position and global shape, which includes the translation rotation and scaling of the face model. We proposed the head cut and packed ring generation method based on the Bezier curve that further solves the interference between components. In the 3D landmark localization experiment, the supplemental landmark average error of the face models on the HFC dataset is approximately 0.2 mm. In the registration experiment, in the case of high precision, the convergence of the restraining landmark position is verified, and the average number of steps is 1125. In the case of real-time application, some measures are also provided to complete the registration in less than 10 s; and compared with the NR-ICP registration, our method has better performance locally and on noncorresponding structure registration. In the model evaluation experiment, the universality and application in virtual try-on are demonstrated, and our method has better performance in virtual try-on compared to SMPL-X or MTC.

Building a 3d Morphable Face Model by Using Thin Plate Splines for Face Reconstruction

A synthesis method for personalized 3D face reconstruction

An Automatic Method of Building 3D Morphable Face Model

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Automatic 3D Face Modeling Using 2D Active Appearance Models

3D3M: 3D Modulated Morphable Model for Monocular Face Reconstruction

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Reconstructing Recognizable 3D Face Shapes Based on 3D Morphable Models.

Fast face modeling based on features and flexible mesh model

Realistic Reconstruction of Human Face Based on Images

Animated Face Modeling and Adaptation with Triangular B-Spline

On Learning 3D Face Morphable Model from In-the-wild Images

A Modeling Method for the Human Body Model with Facial Morphology

Deformable model-based generation of realistic 3-D specific human face

3-D Face Structure Extraction Using Shape Matching Morphing Model

Face Pose Estimation and Synthesis by 2D Morphable Model

Geometrical Consistency Modeling on B-Spline Parameter Domain for 3D Face Reconstruction From Limited Number of Wild Images

Conformal Surface Registration with Applications on Face Morphing

B-spline Shape from Motion & Shading: An Automatic Free-form Surface Modeling for Face Reconstruction

Realistic 3-D human face synthesis based on a deformable face model

3D Reconstruction of Human Face Based on Shape Match Morphing Model