Abstract:Super-deformation in character design refers to a simplified modeling of character illustrations that are drawn in detail. Such super-deformation requires both texture and geometrical translation. However, directly adopting conventional image-to-image translation methods for super-deformation is challenging as these methods use a pixel-wise loss which makes the translated images highly dependent on the spatial information of the input image. This study proposes a novel deep architecture-based method for the super-deformation of illustrated character faces using an unpaired dataset of detailed and super-deformed character face images collected from the Internet. First, we created a dataset construction pipeline based on image classification and character face detection using deep learning. Then, we designed a generative adversarial network (GAN) that was trained using two discriminators, each for detailed and super-deformed images, and a single generator, capable of synthesizing identical pairs of characters with different textural and geometrical appearance. As ornaments are an important element in character identification, we further introduced ornament augmentation to enable the generator to synthesize a variety of ornaments on the generated character faces. Finally, we constructed a loss function to project character illustrations provided by the user to the learned GAN latent space, which can find an identical super-deformed version. The experimental results show that compared to baseline methods, the proposed method can successfully translate character illustrations to identical super-deformed versions. The codes are available on the Internet.

Illustrated character face super-deformation via unsupervised image-to-image translation

Realistic Face Reenactment Via Self-Supervised Disentangling of Identity and Pose

Deformable One-shot Face Stylization via DINO Semantic Guidance

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation

High-Quality Face Caricature via Style Translation

LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example

StdGEN: Semantic-Decomposed 3D Character Generation from Single Images

Joint Geometric-Semantic Driven Character Line Drawing Generation

AutoToon: Automatic Geometric Warping for Face Cartoon Generation

Generating Animatable 3D Cartoon Faces from Single Portraits

FA-GAN: Face Augmentation GAN for Deformation-Invariant Face Recognition

Deep Generation of Face Images from Sketches

Generating Artistic Portraits from Face Photos with Feature Disentanglement and Reconstruction

GAN-Based Unpaired Chinese Character Image Translation Via Skeleton Transformation and Stroke Rendering.

Deep 3D Caricature Face Generation with Identity and Structure Consistency

AGTGAN: Unpaired Image Translation for Photographic Ancient Character Generation

AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learning

IPGAN: Identity-Preservation Generative Adversarial Network for unsupervised photo-to-caricature translation

Character Creation Model and Analysis of Figure Painting Fused with Texture Synthesis Style Transfer Algorithm

UGAN: Untraceable GAN for Multi-Domain Face Translation