Abstract:Modeling realistic human skin with pores and wrinkles down to the milli‐ and micrometer resolution is a challenging task. Prior work showed that such micro geometry can be efficiently generated through simulation methods, or in specialized cases via 3D scanning of real skin. Simulation methods allow to highly customize the wrinkles on the face, but can lead to a synthetic look. Scanning methods can lead to a more organic look for the micro details, however these methods are only applicable to small skin patches due to the required image resolution. In this work we aim to overcome the gap between synthetic simulation and real skin scanning, by proposing a method that can be applied to large skin regions (e.g. an entire face) with the controllability of simulation and the organic look of real micro details. Our method is based on style transfer at its core, where we use scanned displacement maps of real skin patches as style images and displacement maps from an artist‐friendly simulation method as content images. We build a library of displacement maps as style images by employing a simplified scanning setup that can capture high‐resolution patches of real skin. To create the content component for the style transfer and to facilitate parameter‐tuning for the simulation, we design a library of preset parameter values depicting different skin types, and present a new method to fit the simulation parameters to scanned skin patches. This allows fully‐automatic parameter generation, interpolation and stylization across entire faces. We evaluate our method by generating realistic skin micro details for various subjects of different ages and genders, and demonstrate that our approach achieves a more organic and natural look than simulation alone.

Face Modeling and Wrinkle Simulation Using Convolution Surface

Spatially Configuring Wrinkle Pattern and Multiscale Surface Evolution with Structural Confinement

Realistic Wrinkle Generation for 3d Face Modeling Based on Automatically Extracted Curves and Improved Shape Control Functions

A Method For Modeling Wrinkles Of 3d Face Based On Photo

Modeling Expressive Wrinkles of Face for Animation

Lightweight Wrinkle Synthesis for 3D Facial Modeling and Animation.

Prototype Modeling from Sketched Silhouettes Based on Convolution Surfaces.

Fast face modeling based on features and flexible mesh model

Plausible 3D Face Wrinkle Generation Using Variational Autoencoders

Stylize My Wrinkles: Bridging the Gap from Simulation to Reality

A statistical-structural constraint model for cartoon face wrinkle representation and generation

Research on 3D Facial Expression Simulation Technology

Computer-aided 3D Human Modeling for Portrait-Based Product Development Using Point- and Curve-Based Deformation

DeepWrinkles: Accurate and Realistic Clothing Modeling

A Novel Approach to the Detection of Facial Wrinkles

Photorealistic Facial Wrinkles Removal

Modeling kinetics of diffusion-controlled surface wrinkles.

Geometric Modeling Based on Convolution Surfaces

Wrinkle-Crease Interaction Simulation Using Combined MT Model and DP Technique

A Novel Approach to the Detection of Facial Wrinkles: Database, Detection Algorithm, and Evaluation Metrics

Characterization of wrinkle morphologies by surface waviness evaluation method during deep forming of multilayer composite preforms