Abstract:Significant advancements have been made in developing parametric models for digital humans, with various approaches concentrating on parts such as the human body, hand, or face. Nevertheless, connectors such as the neck have been overlooked in these models, with rich anatomical priors often unutilized. In this paper, we introduce HACK (Head-And-neCK), a novel parametric model for constructing the head and cervical region of digital humans. Our model seeks to disentangle the full spectrum of neck and larynx motions, facial expressions, and appearance variations, providing personalized and anatomically consistent controls, particularly for the neck regions. To build our HACK model, we acquire a comprehensive multi-modal dataset of the head and neck under various facial expressions. We employ a 3D ultrasound imaging scheme to extract the inner biomechanical structures, namely the precise 3D rotation information of the seven vertebrae of the cervical spine. We then adopt a multi-view photometric approach to capture the geometry and physically-based textures of diverse subjects, who exhibit a diverse range of static expressions as well as sequential head-and-neck movements. Using the multi-modal dataset, we train the parametric HACK model by separating the 3D head and neck depiction into various shape, pose, expression, and larynx blendshapes from the neutral expression and the rest skeletal pose. We adopt an anatomically-consistent skeletal design for the cervical region, and the expression is linked to facial action units for artist-friendly controls. We also propose to optimize the mapping from the identical shape space to the PCA spaces of personalized blendshapes to augment the pose and expression blendshapes, providing personalized properties within the framework of the generic model. Furthermore, we use larynx blendshapes to accurately control the larynx deformation and force the larynx slicing motions along the vertical direction in the UV-space for precise modeling of the larynx beneath the neck skin. HACK addresses the head and neck as a unified entity, offering more accurate and expressive controls, with a new level of realism, particularly for the neck regions. This approach has significant benefits for numerous applications, including geometric fitting and animation, and enables inter-correlation analysis between head and neck for fine-grained motion synthesis and transfer.

A 3D Human Body Modeling Method Based on Neural Network

Human Body Feature Curve Generating Method Based on Neural Network for 3D Human Body Modelling

Personalized 3D Mannequin Reconstruction Based on 3D Scanning

Three-Dimensional Human Modeling and Dynamics Simulation Based on ADAMS

3D Animation Production and Generation Based on Human Body Base 3D Models

Modeling 3D human body with a smart vest.

Application and Visualization of Human 3D Anatomy Teaching for Healthy People Based on a Hybrid Network Model

A method of sketch-based human body modeling

A Modeling Method for the Human Body Model with Facial Morphology

Dressed human body three-dimensional bare body model calculation method through single Kinect

Extraction of Feature Parameters of Three-Dimensional Human Body Based on Image

Measuring and modeling human bodies with a novel relocatable mechatronic sensor-net

Automatic Location and Semantic Labeling of Landmarks on 3D Human Body Models

HACK: Learning a Parametric Head and Neck Model for High-fidelity Animation

Personal Virtual Human Modeling from Images

3D Human Reconstruction and Animation in Garment CAD

The rapid construction method of human body model for virtual try-on on mobile terminal based on MDD-Net

Shape-from-Mask: A Deep Learning Based Human Body Shape Reconstruction from Binary Mask Images

Status of research on parametric methods for the reconstruction of 3D models of the human body for virtual fitting

Survey: Parameterized 3d Human Body Modeling And Geometric Deformation Technology

Data-Driven 3D Neck Modeling and Animation