Abstract:The 3D human body model for virtual try-on requires not only accurate human body shape estimation but also detailed facial morphology representation. The facial shape and expression of the traditional 3D human body model are neutral with a sense of visual alienation. In addition, the traditional 3D face model lacks complete human body support with a visual sense of suspension. Thus, a new modeling method for the human body model with facial morphology is proposed in this paper. Our model has an accurate representation of human body shape and brings people a sense of self-identity with the model. In this paper, we proposed a 3D landmark supplement method for the facial region of the human body model, which is taken as the registration data. We proposed the weak-rigid local registration between the human body and face model by restraining the sparse 3D landmark position and global shape, which includes the translation rotation and scaling of the face model. We proposed the head cut and packed ring generation method based on the Bezier curve that further solves the interference between components. In the 3D landmark localization experiment, the supplemental landmark average error of the face models on the HFC dataset is approximately 0.2 mm. In the registration experiment, in the case of high precision, the convergence of the restraining landmark position is verified, and the average number of steps is 1125. In the case of real-time application, some measures are also provided to complete the registration in less than 10 s; and compared with the NR-ICP registration, our method has better performance locally and on noncorresponding structure registration. In the model evaluation experiment, the universality and application in virtual try-on are demonstrated, and our method has better performance in virtual try-on compared to SMPL-X or MTC.

3D Facial Expression Modeling Based on Facial Landmarks in Single Image

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

3d Face Modeling From Single Image Based On Discrete Shape Space

3D Facial Similarity Measurement and Its Application in Facial Organization

“Edutainment 2017” a Visual and Semantic Representation of 3D Face Model for Reshaping Face in Images

Reshaping 3D Facial Scans for Facial Appearance Modeling and 3D Facial Expression Analysis

Facial Expression Editing in Face Sketch Using Shape Space Theory

Personalized 3-D facial expression synthesis based on landmark constraint.

3D Facial Expression Reconstruction using Cascaded Regression

Accurate landmarking of three-dimensional facial data in the presence of facial expressions and occlusions using a three-dimensional statistical facial feature model.

Fully Automatic 3D Facial Expression Recognition Using Local Depth Features

A Modeling Method for the Human Body Model with Facial Morphology

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

3D/4D Facial Expression Analysis: an Advanced Annotated Face Model Approach

Quasi-Facial Communication for Online Learning Using 3D Modeling Techniques.

3D facial expression recognition using delta faces

3D Face Landmarking Method under Pose and Expression Variations

3D Facial Modeling for Animation: A Nonlinear Approach

Expressive 3D face synthesis by multi-space modeling

A 3D Statistical Facial Feature Model and Its Application on Locating Facial Landmarks

A novel approach to enhance automatic 3D facial expression recognition