Abstract:Modeling realistic human skin with pores and wrinkles down to the milli‐ and micrometer resolution is a challenging task. Prior work showed that such micro geometry can be efficiently generated through simulation methods, or in specialized cases via 3D scanning of real skin. Simulation methods allow to highly customize the wrinkles on the face, but can lead to a synthetic look. Scanning methods can lead to a more organic look for the micro details, however these methods are only applicable to small skin patches due to the required image resolution. In this work we aim to overcome the gap between synthetic simulation and real skin scanning, by proposing a method that can be applied to large skin regions (e.g. an entire face) with the controllability of simulation and the organic look of real micro details. Our method is based on style transfer at its core, where we use scanned displacement maps of real skin patches as style images and displacement maps from an artist‐friendly simulation method as content images. We build a library of displacement maps as style images by employing a simplified scanning setup that can capture high‐resolution patches of real skin. To create the content component for the style transfer and to facilitate parameter‐tuning for the simulation, we design a library of preset parameter values depicting different skin types, and present a new method to fit the simulation parameters to scanned skin patches. This allows fully‐automatic parameter generation, interpolation and stylization across entire faces. We evaluate our method by generating realistic skin micro details for various subjects of different ages and genders, and demonstrate that our approach achieves a more organic and natural look than simulation alone.

Plausible 3D Face Wrinkle Generation Using Variational Autoencoders

Realistic Face Reenactment Via Self-Supervised Disentangling of Identity and Pose

Lightweight Wrinkle Synthesis for 3D Facial Modeling and Animation.

Semantically Disentangled Variational Autoencoder for Modeling 3D Facial Details

Automatic 3D Face Modeling Using 2D Active Appearance Models

DeepWrinkles: Accurate and Realistic Clothing Modeling

Photorealistic Facial Wrinkles Removal

GENERATION OF REALISTIC 3-D SPECIFIC HUMAN FACE

Research on 3D Facial Expression Simulation Technology

Realistic 3-D human face synthesis based on a deformable face model

Deformable model-based generation of realistic 3-D specific human face

Image-to-Video Generation via 3D Facial Dynamics

Generating Animatable 3D Cartoon Faces from Single Portraits

Towards Realistic Generative 3D Face Models

Realistic Dynamic Facial Textures from a Single Image Using GANs

Video-Driven Neural Physically-Based Facial Asset for Production

IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis

Data-driven facial expression synthesis via Laplacian deformation

3DFaceShop: Explicitly Controllable 3D-Aware Portrait Generation

A Piece-Wise Learning Approach To 3d Facial Animation

Stylize My Wrinkles: Bridging the Gap from Simulation to Reality